Hacker News new | ask | show | jobs
by ilundin 25 days ago
Ok, that seems doable if working perfect, but what is the tool output "i can see the patient list with search functionality and 30 patients" thing in the demo ? Is this not vision detected ? Or are you digging into windows api (making non standard windows components/widgets non working)?
1 comments

ah for the fake EMR demo I was a bit less strict with claude, it was vision detected likely - our MCP has tools for taking screenshots of the screen and inspecting the windows accessibility tree etc