Hacker News new | ask | show | jobs
by killerteddybear 483 days ago
This is a very common mistake with LLMs I find. Lots of people who have high domain knowledge will be very impressed by it due to situations where they phrase questions in such a way that it unintentionally leads it to a specific answer which they see as rightfully impressive, not realizing the information which they encoded in the question.
2 comments

If you carefully study the actual prompt used: it already mentions the tail as a factor. Answer talks more on the tail. Just confidently!

No double blind methodology protocol.

The power of suggestion, ala https://en.wikipedia.org/wiki/Mentalism
So like Clever Hans the horse, in a way? :)

https://en.wikipedia.org/wiki/Clever_Hans

Very accurate comparison honestly -- pattern recognition without understanding or underlying knowledge.