[jonititan]

That's very interesting. I've been using whisper via pip also but I'm surprised you haven't sought to optimize whisper at all?

I've been looking at using compilation in torch but not successful yet as otherwise it can take awhile to run. https://pytorch.org/tutorials/intermediate/torch_compile_tut...