|
|
|
|
|
|
by StefanoC
97 days ago
|
|
|
Can anybody share their setup using 64GB macs? I have an M2 Ultra studio and I'm trying Qwen 3.5 MLX models hosting them from the CLI, but I'm a bit stuck picking bigger models, more context, 4/8 bits, Opus-Reasoning-Distilled, coder... There are a bit too many permutations between mlx CLI flags, env variables, and models. At the moment I'm exploring: - nightmedia/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-qx64-hi-mlx - BeastCode/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit - mlx-community/Qwen3-Coder-Next-4bit |
|
|