Hacker News new | ask | show | jobs
by whimsicalism 768 days ago
what are you talking about? you are wrong, for the record
1 comments
fooker 768 days ago
They have pretty much admitted that GPT4 is a bunch of 3.5s in a trenchcoat.
link
whimsicalism 768 days ago
They have not. You probably read "MoE" and some pop article about what that means without having any clue.
link
matsemann 768 days ago
If you know better it would be nice of you to provide the correct information, and not just refute things.
link
whimsicalism 768 days ago
gpt-4 is a sparse MoE model with ~1.2T params. this is all public knowledge and immediately precludes the two previous commentators assertions
link