[TeMPOraL]

There are at least two distinct issues here this community is concerned about:

1. Telemetry is unethical if the users didn't provide informed consent (opt-in) for it. It's not just a theoretical point - anyone who's worked in tech sector for a while should know most companies cannot be trusted to behave ethically (especially if they took VC funding).

2. There's a certain dysfunction/antipattern that's popular in tech sector, called being a "data-driven company". It's the practice of making decisions through divination from data collected through extensive telemetry, to the exclusion of other knowledge sources (like e.g. actually talking to your users, hallway testing, or thinking things through). This leads to software being optimized in questionable directions - so in a sense, you could say that adding telemetry implies an increased chance the software will become worse over time.

[cylon13]

Worse in a really insidious way too. Optimizing based on engagement for instance could be maxxing the amount of time people spend using a service, while minning unseen variables people care about like their emotional state while engaged. It’s sort of an inevitable thing that optimizers do to things they don’t measure, and it’s an extremely difficult problem to put everything people care about into the equation. Like for instance, think of how horrible a polynomial fit gets for a function just outside the window you are fitting as you add more terms.

[im3w1l]

> But last week, Facebook revealed that it had manipulated the news feeds of over half a million randomly selected users to change the number of positive and negative posts they saw. It was part of a psychological study to examine how emotions can be spread on social media.

Doing such a study would be the first step in optimizing for a good emotional state. But it (quite understandably) led to an outcry which stopped it dead in its tracks.

https://www.nytimes.com/2014/06/30/technology/facebook-tinke...

[pseudalopex]

Sentiment analysis will tell you people have positive feelings about cute animals and negative feelings about friends getting cancer. An extremely difficult problem to put everything people care about into the equation.

[im3w1l]

I think it's way more complicated than that. Like you could measure how much better someone feels after seeing cute animals. Short term happiness isn't the only goal and needs to be traded of with other things, both as informing the user about what their friends are doing (you probably do want to know if they get cancer even if learning about it is sad), trending topics so you are clued into what everyone else is talking about, and of course ads. Learning more about the numbers allows better tradeoffs.

[pseudalopex]

The impact of missing important personal news isn't quantifiable in practice. Different people want different things from the platform too. And Facebook can't put everything people care about into the equation as long as the real goal remains getting them to look at more ads.

[pseudalopex]

> Telemetry is unethical if the users didn't provide informed consent (opt-in) for it.

And if the only way to opt out is not use the product. Or stop using it particularly.

[geoduck14]

>There's a certain dysfunction/antipattern that's popular in tech sector, called being a "data-driven company".

This is sarcasm. Right?