Hacker News new | ask | show | jobs
by deoxykev 655 days ago
Are you able to run 405B? 4Bit quant vram requirements are just shy of 192GB.