[delegate]

Crypto energy requirements go up as the currency gets more traction.

TFA shows that groq is many times faster than GPT-4. Up to 18x groq claims. Faster means less energy. So I think it's just a matter of time until these things become ridiculously power efficient (eg run on phones in sub second times)

[jodleif]

How does faster mean less energy? Thats only true if you’re running faster on the same hardware…

[delegate]

Presumably. Less time the giant chip has to draw power for computation. The point is that everyone's interested in making AI power efficient, while crypto's proof of work is a competition for more power burned hashing and throwing away the result.

[wenebego]

I think they are talking about the case where, hypothetically, there is a 10x increase in speed but only 2x increase in power consumption

[jodleif]

I’m just pointing out that this is not a given…

[drexlspivey]

Bitcoin energy requirements will be cut in half in a few days..

[samus]

It's still a monstrosity compared to a traditional parser. You can even be fancy and use complex parsers that backtrack and can deal with mildly context-sensitive languages (as required for HTML, XML, and many programmin languages), and you'd still be more efficient.