[hobbescotch]

Reminds me, I had to once set up lighthouse scans for thousands of sites and the only way to do this fast enough was to run the tests concurrently on a single machine. But the test results also depended on cpu load of thr machine running the tests, so we had to sample cpu load live and adjust a multiplier in the lighthouse tests to handle this so that lighthouse would not think it is the site that is being slow. I understand it’s a complex tool, but I wish lighthouse results with the cli were more reproducible!

[sanitycheck]

I was going to mention CPU, too. I've noticed in the past that even for a single site (or web app, I guess I should say), it's possible to get somewhat a better Lighthouse score on a fast modern computer than on somethig that's a bit slower/older. I think it causes some devs to miss major performance issues.