[levocardia]

I'm very worried that LLMs-as-therapists will wind up falling victim to the same fate as e-cigarettes. An LLM therapist is ~100x cheaper than a real therapist, and similarly more available on demand (in the same way that ecigs were probably a few orders of magnitude safer, in terms of long-term health effects, vs. traditional cigarettes).

BUT there is also a gold rush temptation for companies to hack together GPT4 + a lazy system prompt and market it as "Digital Therapy (tm)" and screw it up for everyone. Meanwhile the companies doing careful RCTs to show efficacy and safety will be left in the dust, and probably regulated out of existence before they can even go to market.

Just like Juul & co screwed up e-cigarettes as safer alternative to smoking by targeting teenagers who don't use nicotine, as opposed to current cigarette smokers.

[m3kw9]

If LLM continues to get better, prompts become less important. You just say you feel depressed and it will know to talk like a therapist by default and likely be better. E-cigs never evolve that rapidly, as an analogy

[smcg]

It will know how to better extract profit from you. It's not your friend.