Hacker News new | ask | show | jobs
by aprilledaughn 2893 days ago
Yes, you’re right! The report covers data from Instabug users only. We extracted data from 30K apps with a range of user base sizes, locales, devices, etc. I definitely agree with you, it’s not a definitive representation of the market, but we believe we have a good enough sample and that the findings are valuable for app developers.

We couldn’t find any other data on mobile bugs like this, so we decided to share what we have for the app dev community to have some benchmarks and insights.
1 comments
minimaxir 2893 days ago
Sample size isn't the issue here, although a large heterogenous sample is good.

The complaints are e.g. "Most bugs are reported from iPhones" because they are a very popular type of phone with the customers more likely to report bugs. It doesn't necessarily mean the iPhone is buggier than others.

link
aprilledaughn 2893 days ago
Right, we're definitely not saying the iPhone is buggier than others. I guess the issue is with the wording of the claim. It would be more accurate to say "Most bugs reported through Instabug are from iPhones"

That's also why we included the bugs/user data since it shows a completely different distribution across devices.

link