Hacker News new | ask | show | jobs
by runjake 271 days ago
I don't know because I have 36GB memory on Apple Silicon and mostly use models that require around 32GB, but I will say that people underestimate the abilities of ~7b models for many tasks.
1 comments

What ~7b models would you recommend investigating?
Start with the 7b and 8b models popular on Ollama's listings:

https://ollama.com/search?q=7b

https://ollama.com/search?q=8b

It's not showing up high on the list of the above URLs for some reason, but I quite enjoy the deepseek-r1 8b variant: https://ollama.com/library/deepseek-r1

YMMV