Hacker News new | ask | show | jobs
by yehors 404 days ago
Are you using a local Whisper? If yes, what do you use for inference, candle/ort?
1 comments

Not local. Inference is the only part not written in Rust so far.

I am using Replicate to run docker images with a pipeline based on faster-whipser, VAD, pyannote and a custom LLM enhancement flow.

Thanks for sharing candle/ort. Interesting to see the WASM in-browser opportunities