Most of the issues listed by @zmmmmm are the same issues plaguing other VR headsets for a decade now: motion blur, pixelation, distortions, fake looking colors.
I think this is the main thing — plenty of other headsets showed how these aspects are problematic. I very much appreciate just how hard a problem things like hand tracking, distortion, etc. are to solve, but I was hoping (perhaps unreasonably) we’d see a break through in at least one of them. It also feels like Apple design choices got in the way somewhat. Two things that surprised me most are the FoV and limited DCI color space coverage — now I get why they didn’t readily share that spec earlier.
See the video in the OP at timestamp 5:00 to 5:20. The review from The Verge touched on it as well; essentially, at the end of the day, it's still a bunch of displays showing you camera feeds of the real world. And both displays and cameras have a lot of flaws—low field of view, motion blur, pixelation in low lighting, and a much more limited set of colors compared to our actual eyes.
VR avoids this since they just make up their own designed world instead, while most AR glasses avoid this by having actual transparent glasses and reflecting images off them instead. The Vision Pro is more ambitious and tries to pull off both AR and VR, resulting in these compromises.