[Danylon]

Is a mistake still a mistake when it is a profitable action?

If fitting to human irrationality increases generalization performance, then it does not matter if the "machines seem destined to repeat our mistakes", it is still a useful signal. If fitting to human irrationality decreases generalization performance, your algorithm is overfit to noise (and you have bigger fish to fry than human irrationality).

Overfitting to noise is perfectly avoidable, not pre-destined when part of your data is noisy (noisy data is the rule not the exception).