Hacker News new | ask | show | jobs
by pillefitz 1133 days ago
You're missing and getting the point at the same time.

Your solution would be the correct one, while GPT pulls out the "only look once"-constraint out of nowhere. The riddle is perfectly fine.

3 comments

Ah thanks, that clears it up. The formatting made me miss that that was the ChatGPT response. I thought that was the user sharing their solution that they look for.
This is the crux of the problem for GPT, enough of the text is from the “standard” riddle that is cannot break from it to actually answer the question.

I’m seeing this all of the time when trying to get GPT to perform certain answering problems. It’s heavily biased towards the “correct” answer - even when the prompt presents directly contradictory information.

Except the part about "with some changes that make it more difficult" is false. The changes make it trivial.

Edit: Omitting that part still makes GPT4 over complicate the solution