Hacker News new | ask | show | jobs
by throwaway7783 18 days ago
Can you share your local LLM setup?
1 comments
mystraline 18 days ago
Its just my desktop running Krasis. 96GB ddr5, 16GB nvidia 5060. Im running qwen-3.5-80B in int4 mode.

It uses like 45GB system ram and 11GB g-ram.

link