In this video I use OpenAI's Whisper model on a Raspberry Pi to transcode audio from a conference room mic. It works pretty well, but it's far too slow for a lot of applications. With some creative hacking you may be able to make it useful, I don't know!