Hacker News new | ask | show | jobs
by ilaksh 612 days ago
We have already seen multiple plateaus as we reached barriers in terms of scaling the models the hardware and software. We have continued to innovate and break through them. The latest barrier is scaling training via inference time.

New hardware and even learning paradigms are being researched to get us over the next wall. This has been shown time and time again we keep innovating.

The power requirements with force investment to scale out the new memory-based compute paradigms.