[tempoponet]

If llama 3 70b were available for $400 today, people would make it work. They would have 4 of them working side by side or 1 of them working with a GPU on another model.

To me, it's like imagining if Sonnet 3 was burned into an ASIC 8 years ago and then never changed. It would still be revolutionary, and today we would have an entire ecosystem of tools and services built around it, likely surpassing some of our current workflows.

The frontier is a different beast, but it would likely mean competing on price.

[treis]

I think you'd be better off getting 1% of a $40,000 card. Or maybe 10% of a $4,000 card is more realistic.

I think that's the problem at the moment. A much better LLM that doesn't use my battery is 20ms and <10mb of data away.