Hacker News new | ask | show | jobs
by PumpkinSpice 948 days ago
Sort of, but isn't the focus on prompts a bit myopic? The huge difference between earlier GPTs and ChatGPT was RLHF, which not only makes it better at following prompts, but also enforces a lot of hidden dogma. It certainly influences how ChatGPT talks about climate change or AI risks, for example.
1 comments

Training crap is way more complicated than prompt predication and also limiting the flexibility of the model.

You'd be hard pressed to train a visual model so that every group of 3 or more people is "ethnically diverse".

Also ChatGPT climate, race and many other reponses are short-circuited to boilerplate answers, not dogma-trained.