Hacker News new | ask | show | jobs
by klaussilveira 1254 days ago
How well does it do with occlusion? Holding, or manipulating an object, and capturing those interactions.
2 comments
diegomacario 1254 days ago
It does amazingly well. Last May Meta released their Hand Tracking 2.0 update, and the quality of the hand tracking improved enormously. You can see a comparison of 1.0 and 2.0 here: https://www.youtube.com/watch?v=K-l-RXxYnzs&t=4s&ab_channel=...
link
klaussilveira 1254 days ago
What about arms? Or would it have to rely on some realtime IK solution to sort them out?
link
diegomacario 1254 days ago
For the arms you could use Meta's new Movement SDK: https://developer.oculus.com/documentation/unity/move-overvi...

Although in my opinion the arms still look a bit janky. You can see a demo of a sample they included with the SDK here: https://youtu.be/IQt4wTdGK64?t=419

link
karim79 1254 days ago
Was wondering the same thing - if it does well there, it could be a really cheap way to, for example, motion-capture realistic weapon holding in an FPS, provided it can be extended to capture the arms as well using CV.
link
klaussilveira 1254 days ago
It would need some cleanup, but definitely usable.
link