[eurekin]

I'm using:

  ollama run dolphin-mixtral:8x7b-v2.5-q3_K_S

[mark_l_watson]

That runs on 32G? The original mixtral q3 wouldn’t run for me. Maybe the dolphin tuned version is smaller?

EDIT: I just checked, it runs great, thanks.