Hacker News new | ask | show | jobs
by nojvek 3394 days ago
How much computing power does this take. When do you see open source implementations running on mobile devices offline?
1 comments

We take several days (2-3) on 8 Titan X GPUs to train our models, which is quite a lot of compute. Running on mobile devices is quite challenging – the inference is not yet fast enough to support that, and has only been optimized for x86 AVX2 CPUs. It may be possible with a fair amount of future work!
That's pretty quick. Most people take longer to learn how to read that well.