Hacker News new | ask | show | jobs
Ask HN: Where to Host an LLM in 2024?
3 points by holomorphiclabs 806 days ago
What do you use today to host your LLMs? How has your experience been? What are most of your friends using?
1 comments

I do not host LLMs specifically, but almost everything I use is hosted on my own hardware. A Dell R720 costs maybe $500 fully kitted out give or take a few hundred. Plenty of my friends are hosting LLMs on their laptops.

I don't put my stuff on other people's computers unless there's no alternative.