Hacker News new | ask | show | jobs
by jmartrican 29 days ago
Sounds expensive
1 comments

It is. But cash expenditures can be modeled in the business economics. But depending on an unrelated party for a core capability is an existential threat. Imagine if every single computer your business runs on could be bricked without notice or a fallback. You’d go bankrupt within a day. That’s the signal this fiasco has sent.

That being said, I am working on a federated / coop model that will allow smaller companies to pool resources.

The concern would be the ever increasing cost of GPUs. I imagine to help mitigate the risk, having a setup where more GPU's can be added on, and the old ones can still be used (as new ones get added on) would make the endeavor more palatable. Vs. having to swap out old GPUs for new ones, because the money spent on the old ones is lost (or at least some of it is lost if you can find a way to resell them).
I was spending $3000 per month on AI and my team was restrained from using it because we don’t have that type of budget per person. Even $200 per person was a stretch. But we could buy enough hardware that it made sense per person