Hacker News new | ask | show | jobs
by nperez 1008 days ago
ChatGPT uses a 1.7 trillion parameter model IIRC. I wouldn't expect a 70b model to compare well. There are medical finetunes that might be better to try for this, like https://huggingface.co/wanglab/ClinicalCamel-70B

Edit/Correction: as mentioned below, free tier used by OP is in the neighborhood of 175b
1 comments
johntiger1 1008 days ago
Where are you getting the 1.7T number from? Genuinely curious, as sources like [1] generally cite 175B.

[1]: https://ecoagi.ai/articles/chatgpt-parameters

link
nperez 1008 days ago
I'm not sure, I've tried looking it up and couldn't find an official answer. But that site says GPT3 is 175b and GPT4 is 170 trillion. That's insane if true

Edit: and this one says 1.7, idk https://levelup.gitconnected.com/gpt-4-parameters-explained-...

Haven't used chatgpt in a bit, but looks like the free tier is GPT3 still, so 175b may be correct if OP isn't a subscriber

link
johntiger1 1008 days ago
I was testing on GPT3.5-Turbo, the free tier.
link
nperez 1008 days ago
Ah, 175b it is then. That's actually kind of encouraging that an open source trillion+ param model isn't needed to get there.

A 180b Falcon model very recently came out https://huggingface.co/tiiuae/falcon-180B A finetune of this might be competitive, but I haven't tried it.

link
nickthegreek 1008 days ago
That should be in your article.
link