[baq]

Good luck hosting 2.8T params yourself. A box capable of this at a useful performance level is at least $100k.

[Sanzig]

More like $500k, but that's not an unreasonable price for a medium sized enterprise to pay.

I have an RF engineering background, a nice mmWave vector network analyzer can easily land in that ballpark.

If the business value is there, companies will pay for it.

[jfaat]

Not to mention the bill you would be paying anthropic could be way higher at that scale

[unethical_ban]

How much would it cost to run a 2.8T model with long context for 1000 developers, plus 30,000 non-dev employees with short session memory?