[johntiger1]

Where are you getting the 1.7T number from? Genuinely curious, as sources like [1] generally cite 175B.

[1]: https://ecoagi.ai/articles/chatgpt-parameters

[nperez]

I'm not sure, I've tried looking it up and couldn't find an official answer. But that site says GPT3 is 175b and GPT4 is 170 trillion. That's insane if true

Edit: and this one says 1.7, idk https://levelup.gitconnected.com/gpt-4-parameters-explained-...

Haven't used chatgpt in a bit, but looks like the free tier is GPT3 still, so 175b may be correct if OP isn't a subscriber

[johntiger1]

I was testing on GPT3.5-Turbo, the free tier.

[nperez]

Ah, 175b it is then. That's actually kind of encouraging that an open source trillion+ param model isn't needed to get there.

A 180b Falcon model very recently came out https://huggingface.co/tiiuae/falcon-180B A finetune of this might be competitive, but I haven't tried it.

[nickthegreek]

That should be in your article.