[matsemann]

If you know better it would be nice of you to provide the correct information, and not just refute things.

[whimsicalism]

gpt-4 is a sparse MoE model with ~1.2T params. this is all public knowledge and immediately precludes the two previous commentators assertions