Hacker News new | ask | show | jobs
by static_noise 2937 days ago
It may not be in the job description but usually somebody has to clean the data by hand or build specialized tools before it can be used.

Something as simple as a text field for entering a date can produce interesting effects. Even if your data looks good on the surface, when you dig in, you might find interesting things. Like data entered when the system was definitely shut down for maintenance.