[doodlesdev]

Well, that's pretty impressive. Care to share your setup to do that? How much DDR3/DDR4 do you have, too?

[bitwize]

I... downloaded a 4-bit quantized GGUF of the model, used llama.cpp to run it, and pointed OpenCode at that. My machine is an 8-core Gen1 Ryzen 7, 32 GiB of DDR4, (I think) 4 GiB of VRAM on the graphics.

[doodlesdev]

Well... That's much simpler than I imagined LOL, thank you for answering!