Hacker News new | ask | show | jobs
by kingkawn 1214 days ago
it produced cliche because of the cliche quality of the prompt. You can’t expect it to be original when you’ve asked it for a tiresome combination of genre and a canonical work.

If the outputs are boring it ain’t chatgpt at fault…

3 comments

I don’t know the technical details of chatgpt but other language models have a sort of randomness tuning that makes them produce more unlikely stuff. Chatgpt appears to be deliberately tuned to produce very likely, very cliche, very rote output. Great for bloggers or people who want text summaries or boring professional content, not great for creativity. It’s not a ‘fault’ of chatgpt per se but it a consequence of chatgpt’s intentions, not the user’s.
Isn‘t it kind of ironic that we complain about ChatGPT not being „creative“ enough on a thread complaining it fakes academic papers? How can the same bot be limited to only produce „facts“ and at the same time would be useful to generate great „fiction“?

But I completely agree with you: it’s often spitting out boring stuff. And yes, it makes almost everything up based on language statistics and similarities.

Perhaps, we are just in a hype cycle? There are lots of specialty tools and bots available based on GPT-3 customized for different tasks. Complaining that ChatGPT or Bing+ aren’t equally suited for every task gets tiresome. Especially if more than 2/3 of the examples simply follow the pattern „junk in - junk out“.

It would seem that, when you try too hard at being creative, chatgpt usually just loses it completely - in my experience, it often starts falling back on even worse cliches, or it stops making sense altogether. (Or it might just time out.)
Actually, ‘cliche’ is an extremely good evaluation:

It is assessing the quality of the output as if a human had made it. Most of human writing is cliche. Expecting it to produce good output is, as you say, a matter of prompt engineering.