Up to date local AI tools for direct computer/app interaction?

[4midori]

Are we at the point now where I can give plain language commands to an AI tool and have it perform an action on my PC? For example, in Photoshop - "draw a red square, rotate right 40 degrees"? What tools should I research/consider?

[lhmiles]

Not there yet