Hacker News new | ask | show | jobs
by dagmx 633 days ago
Imho hand gestures are the best way to interact with XR.

If your only experience is the HoloLens, you’re roughly a decade out of date with how well it can work today.

There’s also not been much until the Vision Pro that combines eye tracking with hand tracking which is what’s really needed.

You should really try the Vision Pro, because it really does move hand tracking to the point where it’s the best primary interaction method. Controllers might be good for some stuff , in the way an Apple Pencil is, but most interactions do not need it.

3 comments

If the state of the art is the Vision Pro, then all the GP'S complaints are valid. It's not anywhere near good enough to replace a controller.
For what use cases though? Interacting with websites, most apps and content consumption? Hand tracking beats a controller.

Controllers have their strength for games but most things that people do with their computers are better with hand tracking.

> For what use cases though? Interacting with websites, most apps and content consumption? Hand tracking beats a controller.

I can only imagine this is an extreme minority view, as hand tracking is next to useless for these tasks, outside of tech demos.

Why do you need a controller for any of that? Those are all point and click, with low precision and large hitboxes. Which is perfect for eye+hand. Almost every review says hand+eye is greatly intuitive, almost every user in the Vision Pro communities as well. Even Meta are using hands+eyes as the way forward.

What exactly are you missing that a controller gives you for those tasks?

This is a pretty common view for Vision Pro users. Hand tracking is great for these. Can't imagine having to use a controller.

Ofc Vision Pro users are extreme minorities so you are not wrong. But I highly encourage you to try out Vision Pro if you haven't.

I did buy a Vision Pro, but it's a nearly unusable device and outside of fora, I've never met anyone whose had a positive experience, so I suspect even among Vision Pro users, it's a minority opinion.

Hand tracking is not a feasible input method for routine computing.

I'll have to dig mine out of the box and try it again, version 1 of the os basically had one gesture which was click. I hate the gaze and click interface, it works OK for Netflix but invariably I would fall back to using the trackpad on my MacBook to actually do any work.
Subjective preferences aside…

It has almost as many gestures as the trackpad or iPhone though. More gestures can be handled app side.

There’s also direct touch of surfaces too.

Haven't seen that yet, it's a great idea to have a surface provide the tactile "bottom" of a keypress

https://appleinsider.com/articles/23/06/23/vision-pro-will-t...

Hand tracking has also been pretty great on the Quest for some time now. I've got the first-gen one, and you can very comfortably type/navigate the UI with no controllers.