[microcolonel]

I suggest Sikuli, it does fuzzy matching on your screen contents to determine whether to continue with your dirty, dirty hacks.

[pmoriarty]

For a lighter-weight alternative to Sikuli that does not require Java, check out visgrep[1] from the xautomation project.[2]

[1] - https://linux.die.net/man/1/visgrep

[2] - https://hoopajoo.net/projects/xautomation.html

[eastendguy]

For a new light-weight alternative to Sikuli that does not require Java, check out the UI.Vision browser extension + xmodule:

https://ui.vision/x/desktop-automation

[eb0la]

I rememberdemoing Sikuli to the boss, when it clicked where we didn't expected just because the web we were trying to automate had a link we didn't notice.