Hacker News new | ask | show | jobs
by kkielhofner 968 days ago
We have benchmarks[0] for Willow Inference Server using Whisper + ctranslate2 + some of our own optimizations.

TLD a six year old ~$100 used GTX 1070 is roughly 5x faster than a Threadripper PRO 5955WX at a fraction of the cost and power.

[0] - https://heywillow.io/components/willow-inference-server/#ben...

1 comments

> TLD a six year old ~$100 used GTX 1070 is roughly 5x faster

Did you mean TIL?