[obviyus]

Wonder if they'll eventually release Whisper support. Groq has been great for transcribing 1hr+ calls at a significnatly lower price compared to OpenAI ($0.36/hr vs. $0.04/hr).

[Arn_Thor]

Whisper runs so well locally on any hardware I’ve thrown at it, why run it in the cloud?

[swores]

Does it run well on CPU? I've used it locally but only with my high end (consumer/gaming) GPU, and haven't got round to finding out how it does on weaker machines.

[Arn_Thor]

It’s not fast but if your transcript doesn’t have to get out ASAP it’s fine

[obviyus]

That's pretty much exactly how I started. Ran whisper.cpp locally for a while on a 3070Ti. It worked quite well when n=1.

For our use case, we may get 1 audio file at a time, we may get 10. Of course queuing them is possible but we decided to prioritize speed & reliability over self hosting.

[Arn_Thor]

Got it. Makes sense in that context

[BrunoJo]

https://Lemonfox.ai is another alternative to OpenAI's Whisper API if you need support for word-level timestamps and diarization.