Hacker News new | ask | show | jobs
by SyneRyder 10 days ago
Huh. They're not "Pelicanmaxxing"... they're Ottermaxxing.

Take a look at the GLM 5.2 and Deepseek V4 "animal on a plane" examples. In every case, the animal is standing on top of the plane, a clear misunderstanding of the concept of "animal on a plane"... with the exception of the Otter. The otters are sitting in a seat on the plane, looking out the window.

That's Ethan Mollick's "Otter On A Plane Using WiFi" image benchmark.

https://www.oneusefulthing.org/p/the-recent-history-of-ai-in...

(Sometimes the Racoon is sitting inside the plane as well, but the racoon is a common backup benchmark. I'm surprised it wasn't also holding a sign saying that it loves trash.)

Also, Grok seemed to really really enjoy "whale on a plane" in that second round, and kudos to GPT Terra for deciding after 3 rounds that the user was terrible at spelling and generated "Antelope On A Plain".

EDIT: I promise I'm a human, but I did just notice my "that's not x... that's y" construction at the start. I am rather Claudepilled — my apologies.

2 comments

To be fair, when I see that pattern after a relevant question, it isn't much of an AI tell. Consider this exchange: A:"Are you hungry?" B:"I'm not hungry, I'm thirsty."

When LLMs use the pattern, they are often setting up a straw man and then knocking it over.

Thank you for the share, I'm glad AI labs are getting their priorities straight.
But it does come with an Otter refusal to other tasks given.