[andybak]

That's an interesting point but I think it highlights that there are different types of testing - even above the obvious UX vs QA distinction.

I find that really good QA testing often needs someone quite technical and even someone who has some insight into the way the code works. You have to actively think about ways the system could break. It's probably closer to the mentality of a penetration test than it is to usability testing.