Hacker News new | ask | show | jobs
by angrais 1141 days ago
>> I don't know much practically about how hard it would be to take the Whisper PyTorch (1 or 2?) trained models & to make good use of them elsewhere.

What do you mean by "elsewhere"?

The whisper models can be used without much effort. The tooling provided by OpenAI allows for them to be used and installed in python with ease. People use them in companies to transcribe internal media datasets. No need for CPP implementation for internal uses.

Main problem is when _on device_ is required and the OpenAI model is not quantised and so use on say a smartphone becomes trickier.