[dragonwriter]

There are non-OpenAI models based on the same GPT paper as the OpenAI GPT-series, e.g., GPT-NeoX [0], GPT-J, etc., that are actually Open Source, unlike OpenAI which is “open” only in the sense of “we might let you use it, either as a free preview or a paid service”.

You probably won't be able to run (or especially train) them on typical desktops, though.

[0] https://www.eleuther.ai/projects/gpt-neox/

[qup]

Are they good?

[dragonwriter]

That... depends. If you are looking at a pretrained model that competes with ChatGPT out of the box, no.

GPT-NeoX apparently compares favorably with GPT-3 on some measures, but ChatGPT is a 175 billion parameter GPT-3 model, and the big pretrained GPT-NeoX model available is a 20 billion parameter model. Could you rival ChatGPT with the right settings and training set and sufficient hardware for training? Well, if you want to try, you can with GPT-NeoX, and you can chosr whether or how to filter the output. With OpenAI’s models, you get what they give you, on the terms they are willing you give you access to it, with filters that exist tonprotect OpenAI’s image and liability.

[beckingz]

With some effort they're close to ChatGPT in terms of quality. More of one off input output as opposed to a conversation though.

[speedgoose]

It depends on what you use them for.

To replace ChatGPT, no they are not good enough.