Hacker News new | ask | show | jobs
by azinman2 409 days ago
Does it run in 8x80G? Or does the KV cache and other buffers push it over the edge?