Hacker News new | ask | show | jobs
by qup 1264 days ago
Are they good?
3 comments

That... depends. If you are looking at a pretrained model that competes with ChatGPT out of the box, no.

GPT-NeoX apparently compares favorably with GPT-3 on some measures, but ChatGPT is a 175 billion parameter GPT-3 model, and the big pretrained GPT-NeoX model available is a 20 billion parameter model. Could you rival ChatGPT with the right settings and training set and sufficient hardware for training? Well, if you want to try, you can with GPT-NeoX, and you can chosr whether or how to filter the output. With OpenAI’s models, you get what they give you, on the terms they are willing you give you access to it, with filters that exist tonprotect OpenAI’s image and liability.

With some effort they're close to ChatGPT in terms of quality. More of one off input output as opposed to a conversation though.
It depends on what you use them for.

To replace ChatGPT, no they are not good enough.