[xadhominemx]

It’s because the model weights and KV cache are stored in SRAM. It’s extremely expensive per token.