|
|
|
|
|
by fragmede
1311 days ago
|
|
An Nvidia 3090 GPU can run open ai's whisper at 17x realtime[0]. they're not exactly cheap (~$500?), but they're cheap enough that running the transcription end at home is quite feasible. And, it includes translation, so you don't have to do it in English. Searching all of a downloaded copy of Wikipedia wouldn't be that computationally expensive either if the assistant has hot words it picks up to look up. [0] https://news.ycombinator.com/item?id=32928207 |
|
Could just load up a pcie card full of them if necessary. A local home AI would be such a boon to people, not just the average person but the elderly as well, combined with a refined GPT etc it could conversationally respond to requests rather than most assistants' current request->response "I am a robot" scheme.
>Your son called when you were asleep to ask if you wanted to get coffee today, shall I call him back for you or put you through to him? >X, you've fallen! Please let me know you're okay or I will call emergency services for you
It's sad that we have the technology to do this already but haven't.