[chefandy]

It seems to me that for the most capable and useful models, openness almost exclusively benefits businesses, or maybe academic organizations with money for serious hardware. I know what I can run on my 4090 at home but the results pale in comparison to the commercial services. I see why people consider these matters important from a theoretical standpoint but from a practical standpoint it doesn’t seem particularly consequential. I self-host a few FOSS server applications that are primarily sold as SaaS subscriptions, and folks are often very critical of those businesses benefitting from the “open source” label because they’re often seemingly deliberately difficult to self-host. This seems to be an order of magnitude less open than that. Is there some use case for people with reasonable hardware that I’m just not aware of?

[lukeschlather]

I look at this as being for the reasonable hardware of the future. This is starting to look like actual AGI, and I don't think actual AGI is going to run on a 4090. But an H100 starts to sound like a mass-market product even with the $50k price tag if it actually can run an AGI.

[ripped_britches]

You can get cheaper hosting of open weights from a commercial provider than you can closed weights from the same company. So even if you’re not hosting yourself, openness is a major factor for price competitiveness.