[russelg]

Since you have 512GB, might be worth looking into running deepseek4: https://github.com/antirez/ds4

[mgsram]

I have tried plenty of other models with full FP32 as wel. However, in terms of balance between accuracy and speed, I found the Qwen 3.6 27B to be the sweet spot.