Hacker News new | ask | show | jobs
by aimonster2 842 days ago
2x3090s run 70B at 4bit pretty well. Dolphin does great at least for chat. Very coherent.