Hacker News new | ask | show | jobs
by butlersean 1229 days ago
the hand tracking is spot on by the small image in the bottom left hand corner. steady and accurate positioning of two hands. :-)

unfortunately the rendering of the hands in the large window jumps all over the place on firefox, ubuntu, razer laptop. :-(

4 comments

It seems quite stable to me (on Chrome) ... until I weave my fingers from each hand together.

That said, I still think MediaPipe is an excellent piece of ML tech. And, from a dev point of view, quite easy to get working for various things in the browser[1][2]

[1] - MediaPipe Selfie Segmentation for real-life background replacement - https://scrawl-v8.rikweb.org.uk/demo/mediapipe-001.html

[2] - MediaPipe Face Mesh for, well, drawing lines on your face - https://scrawl-v8.rikweb.org.uk/demo/mediapipe-003.html

On my Pixel 7 Pro phone, I'm able to ge represent all kinds of strange hand positions correctly on the screen via my selfie camera.

There is some jumpiness but I am holding the phone in one hand and making hand positions with my other so I'm less concerned about the jiggles.

It has a hard time naturally when all of my fingers are occluded by one another.

Way to go.

Same problem on Chrome (mac M1). For weird positions I can understand as the computer must still interpret the 2D dots in the small screen to 3D coordinates, but even when I just show my hand fingers spread, palm facing the camera, the small image is stable and the 3D image glitches quite profoundly.
Same problem. The hand tracking is really impressive, basically flawless. The rendered hand is all over the place, doesn't match the debug window at all.