[mikojan]

> ChatGPT is so eager to espouse opinions that OpenAI had to nerf it so it doesn't.

That's in the article. It is the poodle's core, too. ChatGPT's creators did not expect it to be able understand ethics. They did not expect themselves to be able to "teach" ChatGPT moral values. Because ChatGPT lacks the intellectual capacity of a 5 year old. And so they simply barred it from voicing an opinion altogether.

It is a very important point. The authors are arguing that this statistical algorithm is fundamentally incapable of overcoming this deficiency because it lacks the critical faculties every human possesses.