Y
Hacker News
new
|
ask
|
show
|
jobs
by
Casteil
912 days ago
How much RAM do you have? Mixtral is a beast and the non quantized model wants 40GB+ of memory.
1 comments
eurekin
912 days ago
Ah, that might be it! I have only 32
link
ukuina
911 days ago
The q2 should fit.
link