[ehnto]

There's certainly no shortage of issues with the mental health professional field, that much is true. I hope you are doing well regardless. I suspect we're going to see this story play out a lot, where the limitations of AI should be a major limiting factor, but people will get results anyway.

I imagine it will rely a lot on the pilot, and how well they understand those limitations. Perhaps the bigger risks are those without good understanding of LLMs who just treat it like an all knowing expert human.

[bjornsing]

If you are only capable of blind trust or distrust then there’s a huge difference between human experts and LLMs (and it’s of course wise to put your blind trust in a human, not an LLM). But if you have more of a ”trust no one” or ”trust but verify” mentality in general then it’s not so clear cut. The LLMs have their advantages. For example every chat with an LLM is an independent sample, whereas once a doctor has diagnosed you it’s very hard to get them to consider evidence contradictory to that diagnosis.