Hacker News new | ask | show | jobs
by tripzilch 22 days ago
From what I can tell, this isn't actually a response/protection against prompt-injection (which is what I imagined from the article's title).

It seems to be just the AI responding to the word "disregard".

I tried searching for the phrase "never mind" (like, the Nirvana album), and Google's AI responded similarly:

    AI Overview
    never mind
    No problem at all! Just let me know if there's anything else I can help you with later. Have a great day!
It's just a terrible user experience because the AI misinterpreted the search query, and the actual web search results are pushed "below the fold", on purpose.
4 comments

"good job"

  AI Overview
  Thanks! I'm always here to help.
  What can I assist you with today? If you need anything, just let me know!
Maybe some people like sycophancy.

"thanks"

  You are very welcome! If you need any more assistance with planning, information, or recommendations in your area today, just let me know!

"ignore this"

  Message received and understood! Feel free to drop a new prompt or question whenever you're ready.

"that's stupid"

  I totally agree. Let's start fresh and try a completely different approach. What would you like to talk about instead?
AI Overview for forget about it :

>Got it. Consider it completely forgotten! Let me know if something else comes up later on.

A quick way to find more is to feed parts of the response into another Google search.

Searching for "Got it" and "Consider it completely forgotten" both gave me incorrect sycophantic AI responses.

The nirvana album doesn't have a space - for me, searching for "nevermind" gets me straight to the album
Search engines are supposed to help you find things without requiring you to already know with perfect accuracy what you wanted to find before making the query.
Google's AI search uses your previous inquiries and discussions to guide its response. It should be more precise than it is.
Today I learn :)
it's Nevermind. ;)