[badclient]

(1) Can't that be accounted for in some manner, especially when you have so much data? Typically when I design tests at work, it is not unusual to add many rules and exceptions to make sure the data is as accurate as possible.

(2) This is where it becomes tricky. You have to understand that these decisions are made at a very local level by small teams with specific goals(for example, "bump revenue from sidebar links by x%"). Also, it is unrealistic to suggest that a company the size of google can only work on super big items when at Google's volume, small improvements can add up and result in hundreds of millions in additional revenue.

(3) Not a fan of the new gmail but using their blue shade experiment as supporting evidence for why their design sucks isn't very powerful.

[raverbashing]

1 No, you really can't account that. You can't account for people's eyes as well. You may make a guess (maybe on display resolution) which is not precise at all.

2 Google does an can certainly work with whatever they want, but they should try the big improvements first. Their work with page loading times is great, and that has been shown to correlate with earnings. But trying to tune the shades when there are more important things to be worked is pointless

3 It goes to show they don't understand design. In some aspects they do (like GMaps) but it seems to be declining