|
|
|
|
|
|
by 7402
20 days ago
|
|
|
With llama.cpp, Intel i9-13900KS CPU, 96 GB RAM, RTX 4070 running locally. The models I'm using right now with that are: gpt-oss-120b-F16.gguf
Qwen_Qwen3.5-27B-Q4_K_M.gguf
Qwen3.6-35B-A3B-UD-Q5_K_XL.gguf
gemma-4-31B-it-UD-Q6_K_XL.gguf
|
|
|