Hacker News new | ask | show | jobs
by Me1000 797 days ago
WizardLM-2 8x22b (which was a fine tune of the Mixtral 8x22b base model) at 4bit was only 80GB.