[xnx]

Reliably serving planet-scale inference is a whole different ballgame.

[maxglute]

It's going to be an increasingly irrelevant game when models make regional scale, i.e. country/sovereign scale inference attainable. Countries that couldn't even role out domestic search pre accessible models that displaces search likely soon can.

[xnx]

For 2024-level tech I agree. The future is multimodal and a lot of processing power will be needed for that.