|
|
|
|
|
|
by bityard
52 days ago
|
|
|
This would likely run fine in just 96 GB of VRAM, by my estimation. Well within the ability of an enthusiastic hobbyist with a few thousand dollars of disposable income. Quantizations are already out: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF |
|
|