Hacker News new | ask | show | jobs
by minimaxir 2893 days ago
Sample size isn't the issue here, although a large heterogenous sample is good.

The complaints are e.g. "Most bugs are reported from iPhones" because they are a very popular type of phone with the customers more likely to report bugs. It doesn't necessarily mean the iPhone is buggier than others.

1 comments

Right, we're definitely not saying the iPhone is buggier than others. I guess the issue is with the wording of the claim. It would be more accurate to say "Most bugs reported through Instabug are from iPhones"

That's also why we included the bugs/user data since it shows a completely different distribution across devices.