[nyrikki]

Automation bias plus the LLM failure mode (compitant, confident, and inevitable wrong) will absolutely cost lives.

I am a fan of ML, but simplicity bias and the fact that hallucinations are an intrinsic feature of LLMs is problematic.

ML is absolutely appropriate and will be useful for finding new models in medicine, but it is dangerous and negligent to blindly use, even quantification is often not analytically sufficient in this area.