[hirako2000]

How has it ever worked. I have thousands of threads with various LLMs, none have that role play cue, yet the responses always sound authoritative and similar to what one would find in literature written by experts in the field.

What does work is to provide clues for the agent to impersonate a clueless idiot on a subject, or a bad writer. It will at least sound like it in the responses.

Those models have been heavily trained with RLHF, if anything today's LLMs are even more likely to throw authoritative predictions, if not in accuracy, at least in tone.

[Fuzzwah]

Every LLM has role play cues in their system prompts:

https://github.com/0xeb/TheBigPromptLibrary/tree/main/System...

[pwython]

I also don't tell CC to think like expert engineer, but I do tell it to think like a marketer when it's helping me build out things like landing pages that should be optimized for conversions, not beauty. It'll throw in some good ideas I may miss. Also when I'm hesitant to give something complex to CC, I tell that silly SOB to ultrathink.

[adastra22]

Every LLM you have ever used has this role play baked into its system prompt.

[hirako2000]

And they seem to always pick the adequate role in my cases, similar roles to what was mentioned in the thread.

[nadis]

I'm still not sure if specifying a role made a difference or not in terms of performance. Different but similar instance, when I tried to create an agent in Claude to play a specific role (frontend / design engineer expert), I found that this seemed to perform worse vs. just using default Claude, but this is all very anecdotal.

[adastra22]

Maybe it is cargo culting at this point, idk. When I first started experimenting with this, about two generations of models back, the role play prompt made a noticeable difference.

Example: with early Claude (pre-Claude Code) if you asked for a Rust program you’d get something that only resembled Rust syntax but was a mix of different languages. “You are a senior software engineer that develops solely with the Rust programming language” or something like this made it generate syntactically correct Rust.

Similar prompts led to better, more focused tests. I find that such prompts are not as necessary anymore, but anecdotally I’ve still felt a difference.