Hacker News new | ask | show | jobs
by boroboro4 389 days ago
It's very hard to find right now but I'm sure they said they don't quantize KV cache, but their weights are in fp8.