[jwblackwell]

It's starting to feel like we'll soon be able to run open source models on our own hardware and use them for serious coding projects. Even if some tasks still need to be handed off to larger closed source models, that's a huge improvement over where we are today.

The trend also seems pretty clear. These models will keep getting better. Coding may already be close to a "solved" problem for LLMs. Yes ofc there will always be frontier stuff that you need gigantic cutting edge models for but let's be honest, most software is not that.

[rjzzleep]

And I feel like the reason why OpenAI was so aggressive with messing up the RAM market, was specifically to make it hard for us to run models on our own hardware.

[bellowsgulch]

People are already doing this today.