No. That is not how AI works. It’s built by people, contrary to some of the more woo-ey hype. There’s no “agency”, or personal desires, or person to desire anything.
Does it take a human to have agency? Doesn't a cat have agency and desire? What about a worm? Where do you make the cut off, and why? If an AI is programmed with a bias towards creating and following "desires", how is it fundamentally different than what evolution installed in us?
We're way too human focused and dismissive of everything that isn't exactly like us.
Present-day reality was only conceptualizable as sci-fi less than a decade ago. If you think it implausible that OpenAI and Anthropic could set their models to scrape the web, perform sentiment analysis on comments (looking for "AI slop", etc.) and auto-finetune themselves to avoid the tells in the commented-on text, I'd like to know why.