Hacker News new | ask | show | jobs
by yodsanklai 929 days ago
Can anyone explain what this means?
1 comments

Possibly a huge leap forward in open-source model capability. GPT4's prowess supposedly comes from strong dataset + RLHF + MoE (Mixture of Experts).

Mixtral brings MoE to an already-powerful model.