|
|
|
|
|
|
by sbierwagen
1574 days ago
|
|
|
Public models like GPT-NeoX-20B need a minimum of 45GB of VRAM. That's two 3090s, (Maybe four, five grand, depending on how much effort you spend on bid sniping ebay auctions) or a single A100 80GB. ($20,000+) Also note that NeoX-20B is pretty good, but it's not GPT-3 quality. |
|
|