Hacker News new | ask | show | jobs
by Gibbon1 978 days ago
I used to design PID controllers where some of the analog readings would be actually bad. And grossly so.

Like 1002, 998, 1004, 48723, 2104, 1003, 997...

Estimating the deviation from the mean of the last n readings and ignoring ones too far out works well. Also calculate the percentage of bad readings and have a way of displaying it.

1 comments

Right! In a case like this, some outliers are just useless for calculating the mean - they come from something else - BUT they might still be useful in a SMART style of trying to detect degradation of the system. A second measure.
My take about these things is you really need to understand what you are filtering for and what you are filtering against. If you don't you'll have a bad time.