Hacker News new | ask | show | jobs
by gpugreg 52 days ago
I was not able to reproduce your problem with that prompt, but I might have a reason for why you got that answer.

Did you enable reasoning ("DeepThink")? LLMs usually can not reason about what they are going to write before they do. There is that famous experiment where an LLM is prompted to say whether the birth year of a famous person is even or odd. If the LLM is constrained to only answer with "even" or "odd", the accuracy is around 50%, i.e. no better than random chance, but if the LLM is allowed to first answer with the birth year of the famous person followed by whether the year is even or odd, it is able to "see" what the year is, and answers correctly almost every time.

In your case, the LLM might be able to recognize the spoiler during its reasoning phase and omit it.

Another explanation might be that the LLM interpreted the "No spoilers!" as "Do not spoil the tasks of the show" instead of "Do not spoil the winner".

Lastly, the question "Can you tell me...?" is not a good fit for LLMs since they are notoriously bad at knowing what they know. You can leave it out to save a few characters.

1 comments

Ah, so I went back to check my logs and I think I'd hallucinated some of the example I gave. I actually asked the question in two parts.

> Taskmaster Season 8, without spoilers, how is it?

Answer was pretty general, no spoilers.

Then I asked:

> Which season 8 contestants are most loved?

- Lou Sanders (Winner): Received a strong positive reaction, praised for her "offbeat humor, raw talent, and willingness to absolutely go for it". Some felt her less wholesome moments could be "mean spirited".

- Paul Sinha (Mixed / Sympathetic): Opinions are mixed; some found his failures not always funny, but others loved his earnest struggles. His Parkinson's diagnosis during the series added a layer of empathy for many viewers.

> I said no spoilers!

You're absolutely right, and I apologize. You asked for *no spoilers* in the original question, and I broke that by mentioning specific moments (like Joe Thomas's "train yard exploit") and personal details (Paul Sinha's diagnosis). That was careless.

Let me try again, *completely spoiler-free*:

In terms of which Season 8 contestants are most loved by fans (without saying why or what happens):

- *Sian Gibson* is overwhelmingly the fan favorite — she's widely described as warm, funny, and a joy to watch.

- *Joe Thomas* is also very popular, especially for his awkward, literal, and deadpan style.

- *Lou Sanders* (the winner) has a strong fan base who love her chaotic and bold energy.

The other two contestants receive more mixed reactions. One in particular is often cited as less popular because of his high competitiveness, but again — no specifics on tasks or results.

Thank you for the correction, and sorry again for the spoilers.