[bobfunk]

Netlify founder here.

The survey is a reflection of what our community responded.

Next is the largest framework in usage and is really will liked by it's users. This is clearly visible in the charts of the survey.

But for the first time we’ve run this survey, Next decreased in usage year over year (from 47% to 46%).

Astro jumped all the way from 11% to 18% with 87% responding they want to use it more.

Eleventy dropped in usage from our respondents from 19% last year to 16% this year.

None of this is an attack on anyone, it’s just data from our survey. The rise of Astro is one of the most newsworthy bits of data from the survey and reflects genuine excitement in the community we’re part of.

[rideontime]

None of this addresses:

- The misleading title change

- The missing methodology document

- The missing context of absolute scores alongside deltas

All things that have changed since last year's survey.

[bobfunk]

We changed the title to better reflect that the survey asks plenty of questions not directly related to jamstack (like usage of AI tools for web development etc).

Nothing changed in the methodology since last year and as always the survey was run by our data team.

If you scroll past the editorial part of what our team found newsworthy in the data and down to the actual survey data, you'll see clear charts of absolute framework usage and detailed breakdowns on satisfaction for each framework.

[rideontime]

Nothing changed since last year's methodology document? How is that possible when that document is full of statistics specific to that year's survey? It's still up for anybody to view: https://jamstack.org/survey/2022/community-survey-2022-metho...

[kreetx]

But the percentage changes are correct, aren't they? I don't think readers will think that the graphs represents absolute popularity, also (IMO) any survey taken by a company will be used for marketing purposes and should be consumed as such. (It's just some text on the internet, nobody is going to take it as gospel.)

[psanford]

It would be nice if the visualization reflected the information you've shared here (including both the absolutes and the amount of change). Then it wouldn't feel misleading and you would not need to write explainer comments on HN.

[bobfunk]

The absolutes are in a bar chart in the framework part of the survey that makes the absolute usage from the responses very clear. The chart Zack took issue with is from the editorial part of the survey where we found the biggest news in the framework section to be the growth and satisfaction for Astro.

[abtinf]

How would you construct such a chart without it being so busy as to be useless?

[jcollins1991]

This comes off as a disingenuous response, by typing out a large block of text while neglecting to address any of the individual concerns written in the article. "it’s just data from our survey" is a cop out -- the presentation of data is just as important as the data itself, and the concerns of underlying bias via communication model presented by Zach all seem reasonable to myself.

It's fine to not be an expert in Data Analysis, and if it's true that the company no longer employs someone with those skills, there should be a greater willingness to make adjustments and corrections when problems are raised with publicized analysis.

[bobfunk]

No that's obviously not true, we have a data team and the survey is run by our data team as it's been every year.