Hacker News new | ask | show | jobs
by RhysU 2049 days ago
Is this sort of upsampling essentially what the eye sees when it "sees" movement?
2 comments

Yes and no. We do hallucinate both temporal and spatial content from any scene we perceive but there's also a big part of the brain which causes you to ignore missing information. For example during a saccade (rapid eye movement) you're basically blind, the brain just edits out of your perceptual stream the part where the world is an incomprehensible blur.
Expanding in this - if you've ever glanced at a ticking clock, and the second hand seemed frozen for a moment, that was the brain backfilling the gap (after the fact!) left by the saccade.

I was aware of the phenomenon (from personal experience) but not fo the cause, but there was a post here relatively recently that went into the details. Apologies that I can't now find it.

I can't find the HN post, but I believe this was the tweet thread that it referenced: https://threadreaderapp.com/thread/1014267515696922624.html
That's the one - thanks!
Our eyes and brain doesn't see frames, they see changes in light intensity. There are cameras that try to mimic this behavior, they're called event cameras. I think they're going to see much more use in robotics in the future, but at the moment they're mainly (or only) used in research.

https://www.prophesee.ai/2019/07/28/event-based-vision-2/

https://www.youtube.com/watch?v=6Sn9-M7qXLk

Event cameras are certainly interesting, but they have their own set of challenges. I do not believe they’re a better choice in any general sense, but can certainly deliver some impressive performance.