[rjzzleep]

Is it hyperbolic though? One of the best things about the compute and memory shortage is that people are going to insane lengths to optimize things to run on lower memory / lower compute devices. If we keep this up for a while and then ramp up memory and local compute production, that AI inflection point may actually come.

Of course, these are a lot of ifs.

[spiderfarmer]

If we advance just 2x in hardware plus 2x in software, all coding can be done on local hardware imho.

[rbanffy]

That’s about 4 years in hardware cadence alone. There is a lot of room to improve memory bandwidth, and performance is a given with every process node. IBM has shown yesterday they can do limited runs on 0.7nm (density equivalent).