[DemetriousJones]

I tried running the 8B model on my 8GB M2 Macbook Air through Ollama and it was awful. It took ages to do anything and the responses were bad at best.

[redman25]

Doesn't 8B need at least 16gb of ram? Otherwise, your swapping I would imagine...

[blebo]

Depends on quantization selected - see https://www.canirunthisllm.net/