[vkweb]

I have been involved with something similar in the past. But I didn't enjoy it after some time. It was end to end testing with AI agent.

I am curious to know your motivation behind making this?

You wanna integrate this into a product? or was it a try to optimize on Claude's cost?

[mkagenius]

One close to my heart use case is to enable older people use phones easily.

Most of the app UIs built today is so difficult to use, people unfamiliar with technology find it even more challenging.

This tool if enabled with voice and freed from adb shackles can make it so convenient for the older folks or even the blind folks.

Part of my tool(finder) can even be used to create a walkthrough overlay on the screens.

Getting local models to eventually drive all this is the goal. Cost reduction due to that is a nice by-product.

More use cases I can think of will be in the security space, automating logins to test apps, for example. Using app+mitmproxy+llm to do some automations around security.

[vkweb]

I like the walkthrough use case.

For older people, they should find more use with Google assistant / siri doing simple tasks for them like calling, playing music, playing videos and so on.