[famouswaffles]

>The difference is that an LLM isn't 1000 different intelligences. It's one intelligence, being asked to pretend to be 1,000 different people.

No it's not. It does no good for a Language Model to configure a global persona. It needs to be able to predict text from wildly varying backgrounds and contexts. It's not pretending anymore than anything else it does is pretending.

That's why experiments like the below actually work

Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus? (https://arxiv.org/abs/2301.07543)

Out of One, Many: Using Language Models to Simulate Human Samples (https://arxiv.org/abs/2209.06899)

A perfect LLM would predict Einstein as well as it would predict the dumbass down the street.

Now RLHF does incentivize a more global persona by default but stepping away from that is trivial