When I write these days, I am more aggressive in using "I", so it's clear it's my own voice. Generally, an LLM is less prone to self-reference like that unless it's prompted to, I guess.
I've found they are increasingly doing this in ways that are somewhat creepy. For instance, you might share something, and the AI will say, "One of the things I most frequently notice..." or "What I often feel..."
It used to be that the "you are not an I and you must not pretend to have experiences" training that produced the "As a Large Language model, I don't have experiences like humans do, but..." in replies I remember from the early days of LLM chatbots kept these to the minimum.
But one of the things I most frequently notice is that LLMs increasingly make those claims, about things that are very obviously out of their wheelhouse as far as even theoretical experiences, like pretending to have played a video game.
I was recently a bit annoyed by ChatGPT responding with something like "I can't tell you how many times I've lost small tools in an engine bay" in an apparent attempt to commiserate.
I worked on a fine-tuning projects where the ultimate customer was a major provider, and their style guide at the time required us to fail any response that used "I". I've noticed the same as you, so I guess that is out the window.
It used to be that the "you are not an I and you must not pretend to have experiences" training that produced the "As a Large Language model, I don't have experiences like humans do, but..." in replies I remember from the early days of LLM chatbots kept these to the minimum.
But one of the things I most frequently notice is that LLMs increasingly make those claims, about things that are very obviously out of their wheelhouse as far as even theoretical experiences, like pretending to have played a video game.