Hacker News new | ask | show | jobs
by twobitshifter 1 hour ago
Probably the data center where the model is running more than anything. Another option is if Opus is using anything like a Mixture of Experts approach, in which case the amount of the model loaded in memory at one time could be smaller than GLM.