[aiappreciator]

Even in the absence of AI, what's stopping this friend from going to a quack 'natural therapist'? If Steve Jobs can be fooled, what about an ordinary person?

ChatGPT is motivated by sycophancy, humans are motivated by profit. I would say the latter is much more dangerous than the former when it comes to medicine.

Remember, totally legit doctors were peddling opioid pills to patients in the name of "Treating undertreated pain". Profit distorts human minds very easily.

AI doesn't need to be perfect in every situation, just much better than the status quo.

[PragmaticPulp]

> Even in the absence of AI, what's stopping this friend from going to a quack 'natural therapist'?

It takes a lot of time, effort, and money to shop around to numerous doctors until you can find someone who will tell you exactly what you want to hear about your alternative medicine theories. He tried, but was always complaining about the doctors/naturopaths.

But at home, all he had to do was open ChatGPT and spend a few days learning how to prompt it to provide the answers he wanted.

The situations are entirely different.

[gl-prod]

> just much better than the status quo

The status quo being regular doctors? Because that's the status quo, professional doctors.

Having a bot that you can cue and prime towards something is very dangerous in the medical scene.

> Remember, totally legit doctors were peddling opioid pills to patients in the name of "Treating undertreated pain". Profit distorts human minds very easily.

If ChatGPT was trained on those same data that these legit doctors were taught, it would lead to the same diagnosis.