[BoiledCabbage]

Maybe I'm missing something, but this seems like a really poorly worded riddle. Or just a bad riddle.

Given what you stated, the solution would be walk upstairs look at the 3 bulbs, walk downstairs switch one of the switches. Walk upstairs see which bulb changed on/off. Repeat for the other two switches.

This takes roughly 5 mins rather than your solution which takes 3 years.

[pillefitz]

You're missing and getting the point at the same time.

Your solution would be the correct one, while GPT pulls out the "only look once"-constraint out of nowhere. The riddle is perfectly fine.

[BoiledCabbage]

Ah thanks, that clears it up. The formatting made me miss that that was the ChatGPT response. I thought that was the user sharing their solution that they look for.

[SkyPuncher]

This is the crux of the problem for GPT, enough of the text is from the “standard” riddle that is cannot break from it to actually answer the question.

I’m seeing this all of the time when trying to get GPT to perform certain answering problems. It’s heavily biased towards the “correct” answer - even when the prompt presents directly contradictory information.

[redox99]

Except the part about "with some changes that make it more difficult" is false. The changes make it trivial.

Edit: Omitting that part still makes GPT4 over complicate the solution

[mirekrusin]

You just passed the test that you're not LLM.