Hacker News new | ask | show | jobs
by redman25 497 days ago
Doesn't 8B need at least 16gb of ram? Otherwise, your swapping I would imagine...
1 comments
blebo 497 days ago
Depends on quantization selected - see https://www.canirunthisllm.net/
link