[aix1]

I think that "Generate a strong password" is a pretty clear and unambiguous instruction. Generating a password that can be easily recovered is a clear failure to follow that instruction.

Given that Claude already has the ability to write and execute code, it's not obvious to me why it should, in principle, need an explicit nudge. Surely it could just fulfil the first request exactly like it fulfils the second.

[plagiarist]

It's not actually thinking, though. There's no way for it to "know" it will be wrong because it wasn't trained on content covering that.

Maybe in the future companies making the models will train them specifically on when to require a source of true randomness and they might start writing code for it.

[aix1]

> It's not actually thinking, though.

That may well be, I genuinely don't know. However, consider the following thought experiment:

Ask a random stranger on the street[*] to "generate a random password" and observe their behaviour. Are they whipping out their Python interpreter or just giving you a string of characters?

Now ask yourself whether this random stranger is capable of thought.

I think it's pretty clear that the former is a poor test for the latter.

[*] someplace other than Silicon Valley :)

[lm28469]

It's 2026 on hackernews of all places and people still think llms "know" stuff, we're doomed...