[timy2shoes]

Similarly, I recall a talk by Daphne Koller where she talks about a heart attack predictor using X-rays as input. They found that stents were the biggest factor for positive prediction. Which is useless because the doctor would know if the patient had a stent.

[abrichr]

A similar story I heard from colleagues in the field was about a CNN trained on images of tumors that ended up learning to identify images containing rulers that were placed there by a human for reference.