|
|
|
|
|
|
by ionwake
305 days ago
|
|
|
I did just that , got the r 32gb ram one so I could run qwen. Might still be early days I’m trying to use the model to sort my local notes but I don’t know man seems only a little faster yet still unusable and I downloaded the lighter qwen model as recommended. Again it’s early days maybe I’m being an idiot I did manage to get it to parse one note after about 15 mins though. |
|
|
gpt-oss-20b eats too much ram to use for anything other than an overnight task. maybe 3tok/s.
Been playing around with the 8b versions of qwen and deepseek. Seems usable so far. YMMV, i'm just messing around in chat at the moment, haven't really had it do any tasks for me