Hacker News new | ask | show | jobs
by thetoon 360 days ago
What amount of VRAM is this supposed to work with?
1 comments

Today… about 18-20GB.

Tomorrow… like 4GB if you have an hour.

> Today… about 18-20GB.

There's an FP8 version that's the default for the ComfyUI template that's in the release that just came out with Kontext support that I've seen reports of running in 12GB or less, and which I'm running at this moment in 16GB.