Hacker News new | ask | show | jobs
by kleiba 648 days ago
What is the recommended hardware to run a model like that locally on a desktop PC?
1 comments
tadasv 648 days ago
you can easily run 8b yi coder on 4090 rtx. Probably could do on a smaller gpu (16GB). I have 24gb, and run it through ollama.
link