Hacker News new | ask | show | jobs
by petrogradphilos 2399 days ago
> 1 Introduction

> The increased availability of data linking students to teachers has made it possible to estimate the contribution teachers make to student achievement.

There was some data available before (or the sentence would not have used the word "increased"). Why wasn't it possible to estimate with that?

> By nearly all accounts, this contribution is large.

It goes on to talk about what "large" means:

> Estimates of the impact of a one standard deviation (σ) increase in teacher “value-added” on math and reading achievement typically range from 0.10 to 0.30σ, which suggest that a student assigned to a more effective teacher will experience nearly a year's more learning than a student assigned to an less effective teacher (Hanushek & Rivkin 2010;...).

(Typo: "an less effective" should be "a less effective".)

A "range from 0.10 to 0.30σ" doesn't make sense. A Greek lowercase sigma (σ) is used to represent one standard deviation, but the sigma is used only on the upper end of the range. Should it have been from 0.10σ to 0.30σ?

And how are they measuring the impact on achievement of an increase in teacher "value-added", anyway? It says that estimates of the impact "typically range from 0.10 to 0.30σ", but it doesn't say what units those figures are in.

The sentence goes on to say that those unit-less estimates "suggest" that "a student assigned to a more effective teacher will experience nearly a year's more learning than a student assigned to an less effective teacher". Over what time period? That is, how long does a student have to study under a "more effective teacher" to get "a year's more learning"? 1 week? 12 years? It doesn't say.

And finally, how do those unit-less estimates "suggest" an impact measured in learning time? It doesn't say.

3 comments

You are being absurdly pedantic. For example

>A "range from 0.10 to 0.30σ" doesn't make sense.

Out loud, you might read it as "oh point one to oh point three sigma." And it's fine. Ever written a phrase like "it's very expensive, costing somewhere around $3-4M" with one "$" and one "M" but two numbers?

NYC data goes back to 1999, but only for some basic things like test scores. They probably don't have the consolidated links between students and teachers outside of the years they analyzed, due to differing data formats and general laziness.

It's a terrible paper in general though, for example it references Bitler et al. 2015 but never provides a full citation.

Your complaint about sigma is extremely pedantic - it’s very common to write something like “four to eight percent” and everyone understands what is meant. It’s not even erroneous in a purely technical sense.