Yeah I can't reproduce this with my AirPods Pro either. Simply connecting does nothing. I would assume something is causing a stray input as if you'd pressed the button on your headphones, which can launch Music.
I've definitely seen it launch as I put my AirPods Pro into their case (but not consistently), so maybe it is something with the pressure-sensitive stalks. Thanks, I hadn't considered that possibility.