Use AI to do (species) recognition on photos

[yanokwa]

@LN shared an approach to do something similar with audio, where you use an API integration to process submissions with recorded conversations and you update those submissions with the transcriptions. You can do something very similar with photos...

Python script to update submissions of a form with an AI-generated transcript of its audio attachment(s)

I've been playing a bit with OpenAI's Whisper transcription library. The open source library is relatively small and can be run on simple hardware. It's highly accurate for English even with relatively small models. It can also do translation and there's good information on how likely it is to be correct for each language on the Github page. I put together a small script that can be used to update submissions of a form with a transcript of an audio file from that submission. This approach would…