[monerozcash]

There are people receiving life-saving medical advice from LLMs every single day.

The problem isn't getting medical advice from LLMs, it's blindly trusting the medical advice a LLM gives you.

You do not need to trust the LLM for it to be able to save your life, you do need to trust the LLM for it to be able to harm you.

[jfindper]

>There are people receiving life-saving medical advice from LLMs every single day.

Is this just a vibe thing or has anyone actually done some statistics on this?

Sounds like it's something you assume is true solely based on the fact that you personally feel like LLMs are good at medical advice.

[monerozcash]

>Is this just a vibe thing or has anyone actually done some statistics on this?

There's extensive reporting on this from pretty decent news sources, and countless forum posts from seemingly real non-throwaway accounts which aren't otherwise spamming LLM content.

> based on the fact that you personally feel like LLMs are good at medical advice.

No, I don't think that's the case. LLMs sometimes give good advice, the bad advice isn't harmful unless you blindly trust the advice.

People go to a doctor or two, their symptoms are dismissed as [insert very common problem here], ask LLM, receive advice suggesting that [uncommon condition] also fits the symptoms and then take that to a doctor.

This also happens using Google every day. LLMs aren't special, they just make searching the internet a bit easier.