Hacker News new | ask | show | jobs
by modeless 818 days ago
Eye tracking does not work nearly as well as people imagine. It cannot directly replace a mouse pointer the way you want it to. The accuracy and reliability are not good enough and never will be due to physical constraints. This system is likely already working better than an eye tracker would for cursor control, and it will certainly improve.

Apple has done great stuff with eye tracking on Vision Pro, but it required completely rewriting the UI for literally everything. Not something we have the luxury of doing for accessibility for quadriplegics.

Source: built an eye tracker and eye-controlled UI at a startup and got acquired by Google

2 comments

I hear you. I literally cant use any commercial tracker because of a alternating strabismus and the midas touch effect is a nightmare. I'd argue Apple did that because its such a mess on regular OS where the primary input method isnt eye gaze. (They did that with iOS too - match the OS and UI to the primary access method)

I'm not sure I can believe this "This system is likely already working better than an eye tracker would for cursor control" - the training to use this stuff isnt just 'magic'. I do agree though with "and it will certainly improve" - yeah iterate.. iterate..

Eye tracking on AVP works very well on websites that are not at all designed for it.