Hacker News new | ask | show | jobs
by sharbloop 747 days ago
Which GPU card can I buy to run this model? Can it run on commercial RTX3090 or does it need a custom GPU?
2 comments
Havoc 747 days ago
3090 or 4090 will be able to run quantized 22B models.

Though realistically for code completion smaller models will be better due to speed

link
TechDebtDevin 747 days ago
Easy..
link