[simon_weber]

I do a lot of this kind of work for gmusicapi, and I still keep a Windows VM around just to use Fiddler.

Does anyone have recommendations for other tools? I came away from Burp and Charles disappointed in the past, but that was some time ago.

[goodside]

The most universally effective solution I've seen is Sikuli running in a VM (which is the only sane way to run it, since it hijacks your input devices). Everything else fails in some edge case. What other tool can scrape an interface that uses both HTML and Flash and is only served over HTTPS?

It is brittle, in that it can be broken by cosmetic UI changes, but the maintenance is generally trivial. Also, it's slow as all hell. But sometimes you really need that sledgehammer.