Hacker News new | ask | show | jobs
by PaulHoule 176 days ago
I think it's the memory which is the bottleneck more so than processing speed and the obvious levers to push on are:

- more memory efficient models

- a whole system approach to getting better performance out of a less capable model

- more memory

the memory crisis, Micron shutting down a beloved brand that built trust over almost 30 years, and all of that is an economic externalization of memory as the bottleneck.