Hacker News new | ask | show | jobs
by Lerc 213 days ago
Algortithms: State space models, diffusion models, KANs, hierarchical attention. There are no shortage of ideas. Determining what works well is a process that is going on right now.

The question on planning on HBM is too vague to really address, but people are separately working on providing more bandwidth, using more bandwidth, and figuring out how to not need so much bandwidth.