Hacker News new | ask | show | jobs
by speedgoose 1143 days ago
1. The best hardware you can afford.

2. Take a look at huggingface.co

3. Rent for shot periods, buy if you need it for a long time. You can do the maths.

4. Smaller models, quantization, running on CPU when the speed and increased energy usage isn’t a problem.