Hacker News new | ask | show | jobs
by nbuujocjut 520 days ago
Will most organisations be building out their own AI Infrastructure? I would guess in most cases they would either use APIs to existing models (OpenAI etc) or use cloud providers where they need to run and train their own models. Is there a risk that cloud providers cannot meet the demand?
2 comments

Certain companies have very strict data handling requirements, and can't just send data off-site.
Yes, and those companies are a minority. I wouldn't be surprised if AI providers developed solutions for them. Almost immediately we saw tinybox emerge, old Tesla cards doubled and tripled in price on eBay, and Nvidia announced Digits so there's definitely interest in offline solutions.
> Is there a risk that cloud providers cannot meet the demand?

Waste? Cloud providers are super expensive and can't generally justify this expense with the benefits of outsourcing.