Hacker News new | ask | show | jobs
by rcarmo 503 days ago
There's also a 22b model that I appreciate, since it _almost_ fits into my 12GB 3060. But, alas, I might need to get a new GPU if this trend of fatter smaller models continues.
1 comments

That's the older version (4 months old), check the release date.
Ah. I need to find a tighter quantization then, if it exists at all.