Hacker News new | ask | show | jobs
by AureliusMA 42 days ago
How large would a 1 billion token kv even be ?!
1 comments
AntiUSAbah 42 days ago
30TB for 4 bit, 60tb for 8bit res
link