[lukebuehler]

I work with large enterprises that _only_ run critical workloads on locally hosted models. Think banks, insurance, etc--businesses that absolutely cannot leak any data. They also have CC and Codex, but their use is extremely restricted; anything of consequence runs on models running on GPU clusters in their own datacenter.

[chiply314]

I work at large enterprise and they are happy paying Microsoft and AWS for model hosting.

But for sure there will be use cases of very critical data, but at the end the question will still be how big they are in comparision to the rest of the market.

These cricial workloads also have the cost issue, right? so will they reduce workforce to compensate for the budget?