[avs733]

>This. Universities and online challenges provide clean labeled data, and score on model performance.

First homework assignment in the stats class I teach is to clean data that the class generated with directions they all perceived as clear. It's near about the most hated assignment I have ever given. Amazing how many ways there are to encode gender of a experimental participant.

Male, M, m, male, Man, ...

[plants]

gender.lower().startswith('m')... done! :)

[bart_spoon]

Except a real dataset will have its fair share of "nale", "amle", etc.

[avs733]

I would pay student who figured that out $20