Hacker News new | ask | show | jobs
by visarga 1496 days ago
GPT-3 sized models need that kind of memory for inference
1 comments
sudosysgen 1496 days ago
GPT-3 is more like 300GB iirc
link