[xamuel]

In your estimation, how far away are we from eye-tracking software being able to detect the start of a microsaccade, estimate where the gaze is moving toward, and draw new contents on the screen there before the gaze even reaches that point? I would think that by "hacking" into human brain "vulnerabilities" like saccadic masking and chronostasis, such software could potentially yield seriously trippy and mind-altering results!

[natebleker]

There’s two parts to that implementation of such a system, and they’re both interesting! The first part is detection of a micro saccade which is already available in research systems I have personally worked on. You can basically crank up the camera frame rate until you’re around the micro saccade range and do some clustering analysis on the positional data to decouple the hardware moving vs the face. The second part is having a fast enough reliable commercial grade displa system to present stimulus on. Displays are very fickle in practice and getting your hands on one that can run with adequate color, contrast, and brightness at speed is currently very difficult. One angle under research currently is the perception of stimulus during saccades and micro saccades. There’s quite a bit of time and effort in the industry going into neurological assessments through saccades, the tools coming out of this are really starting to come down in price. This opens the door for a bunch of lower priced research options, such as the parent article, to enable a much more rapid pace of understanding.

[tootie]

That's fascinating, but I'm wondering what is the practical value of detecting microsaccades? Aren't they just involuntary twitching?

[taneq]

For the duration of the microsaccade, you're blind. So if something changes onscreen it's much harder to see.

IIRC people have used small orientation changes during microsaccades for redirected walking in VR. You feel like you're walking straight but you're actually curving back on yourself.

Edit: I think that was just detecting full-on saccades but a microsaccade version would be smoother and harder to detect.

Source: https://blog.siggraph.org/2018/05/challenge-accepted-infinit...

[natebleker]

They’re looking to be increasingly more interesting as a biomarker for MS among other things [0]. There’s a lot we still don’t know about our visual systems and the advent of lower cost hardware is allowing huge amount of interesting questions to be hypothesized and tested. It’s a great time to be in the science behind all of this, like the authors at Brown on this paper!

[0] https://iovs.arvojournals.org/article.aspx?articleid=2670267

[trishume]

I believe this might be available in less than 5 years, potentially less than 2, provided both http://www.adhawkmicrosystems.com/ and https://www.kura.tech/ ship and partner with each other. If either one of those companies dies or their technology doesn't work out like I hope, then it might be a while longer.

[thaumasiotes]

"How far away are we" is a strange question to ask about something we already do. You can read about this technique being used to investigate how we read here: https://docs.microsoft.com/en-us/typography/develop/word-rec...

Note the citation to a study that used the technique in 1975.