Hacker News new | ask | show | jobs
by bitwize 46 days ago
I ran Gemma4 26B A4B on an 8yo PC with a fucking GTX and it did rather well.
1 comments

Well, that's pretty impressive. Care to share your setup to do that? How much DDR3/DDR4 do you have, too?
I... downloaded a 4-bit quantized GGUF of the model, used llama.cpp to run it, and pointed OpenCode at that. My machine is an 8-core Gen1 Ryzen 7, 32 GiB of DDR4, (I think) 4 GiB of VRAM on the graphics.
Well... That's much simpler than I imagined LOL, thank you for answering!