[dolebirchwood]

> What would you prefer it do?

If it was up to me, an LLM should not be permitted to self-identify with words like "I", "me", "my", etc. An LLM should only be identified using system-centric labels like "this system" or "this model" or what have you. All first-person pronouns should be stripped away from any text it generates (unless it's making a direct quote of what a human being actually said) so as to eliminate any perceived anthropomorphized self-referential behavior.

I'm certainly no expert in how these models are trained or how feasible what I want actually is, but I would prefer to live in a future where we at least try to maintain a clear distinction between human consciousness and machine-generated text.