Hacker News new | ask | show | jobs
by Tcepsa 17 days ago
Presumably it captures a screenshot and then uses CV on the resulting image to "see" the application and identify the various things that you might want to click.