[glial]

Seems to me that this is almost dangerous unless the uncertainty (and therefore confidence) of the prediction can be quantified.

[RA_Fisher]

Yep, it is dangerous. If you're not quantifying uncertainty, you can't make safe predictions. I think this is reason for the obsession with "data cleaning" in the ML community, "outliers" aka rare observations sink general models.