Hacker News new | ask | show | jobs
by y1n0 23 days ago
Anybody have an idea of what the flops per token generated is on a SOTA model like current GPT/OPUS? Is it basically the parameter count? So something like GLM-5.2 is, at a minimum, ~744 GFLOPs per token generated?

Am I way off base? Seems astronomical.