What made you think we'd ever need AI tokens as much as we do bandwidth, or that they are even comparable.
Bandwidth is abstract, it's information flow. LLMs are a specialised tool, they are based on noise and randomness, and thus are inherently imperfect.
We could have guaranteed the elimination of famine world-wide for 100 years from the resources we wasted on the AI infrastructure in the last 5 years. Shame on us.
There's usefulness in LLMs but not that much. They are definitely not the future.
Bandwidth usage isn't bound to power cost, e.g. a 10x increase in BW between NY and LA doesn't use 10x more power or likely even increase running costs outside of what could be called noise. Token generation however is more or less tied to power costs. There is nothing comparable between the .COM and AI bubbles and the likely outcomes.
Bandwidth is abstract, it's information flow. LLMs are a specialised tool, they are based on noise and randomness, and thus are inherently imperfect.
We could have guaranteed the elimination of famine world-wide for 100 years from the resources we wasted on the AI infrastructure in the last 5 years. Shame on us.
There's usefulness in LLMs but not that much. They are definitely not the future.