Ask HN: What is your go-to prompt to prove AI can be wrong?

[throwaway_887]

Just over-heard one of our seniors trying to explain to a new intern that AI can actually be wrong, no matter how much its answers sound very eloquent and well-structured.

I was wondering what question/prompt everyone uses to prove so to others.

I assume it depends on each person's expertise, or some people ask about a fact that is well-known as having been a victim of the mandela effect.

P.S. As a non-native speaker, I was about to pass my submission through AI to improve text clarity and understandability, but after remembering some comments about prefering the original text, I decided against it :)

[al_borland]

Ask an AI anything you have even a remotely decent understanding of and it becomes pretty obvious that they are often wrong. I run into this on a daily basis for questions spanning multiple topics.

It worries me that interns are needing to have this proven to them.

[saidnooneever]

i think the proof is in understanding how LLMs work, not a certain prompt. this because output isnt determenistic and hence a single prompt couldnt (theoretically) reliably prove anything. thats the exactly problem :')

[haute_cuisine]

I'm curious, why exactly output is non-deterministic? Static weights + matrix multiplication should always return the same output, right?

[mejutoco]

No, even with the same temperature.