[jawns]

But what about content that changes on each page load, like a timestamp or a rotating banner ad? Would that be flagged as a regression?

[mpotter]

Yeah, it's not perfect but right now we're solving this with tolerance thresholds on the image diffs.

[maerek]

Can you share any more details on how the image diffing is done? BBC has a github repo called Wraith that uses ImageMagick and PhantomJS to accomplish a similar task (without the awesomeness of on-demand testing environments). Always curious to learn more about how people are solving the GUI testing problem on the web.

[dbarlett]

There's also Depicted (dpxdt)[1] - more workflow, Python instead of Ruby.

[1] https://github.com/bslatkin/dpxdt