Hacker News new | ask | show | jobs
by BillyTheMage 806 days ago
I do not host LLMs specifically, but almost everything I use is hosted on my own hardware. A Dell R720 costs maybe $500 fully kitted out give or take a few hundred. Plenty of my friends are hosting LLMs on their laptops.

I don't put my stuff on other people's computers unless there's no alternative.