Hacker News new | ask | show | jobs
by codybontecou 450 days ago
I think it's to give the LLM control of your browser.
1 comments

So instead of specifying explicit selectors, etc, you just use a prompt? (like "Go to eBay.com, search for Playstation 5, and click on the first result that isn't a promoted listing")
Yes, exactly. It defaults to using the Chrome accessibility tree but it can also be run so it uses Claude's vision feature against screenshots instead.