| > oh really? because that’s not how they’re being advertised or marketed. they’re being touted as oracles that can answer any and all of your questions No, they're being advertised as useful tools. Obviously the tool salesmen are gonna inflate their capabilities, but in the past few years I've never heard ANYONE important make the claim that they're always correct. I've seen that used as an attack pretty often though. > ai psychosis is a documented and real phenomena. people fall into rabbit holes because of the sycophantic nature of the models. Yes but it's not like random otherwise healthy people do this which seems to be what you're implying. There are clearly other risk factors at play here and it's not obvious how much the AI is contributing. Psychosis isn't new and AI hasn't moved the needle much. > and the models are sycophantic not because it makes them better at answering questions, the sycophancy makes them worse at that. they’re made more sycophantic because it gets people to engage with the models more and more. Or... people just happen to like it when the model speaks in a friendly voice and that desire is impossible to separate out when you're figuring out if an LLM's response is good. Don't try and put this on American companies when you can just go to r/MyBoyfriendIsAI and see pretty plainly that lots of people insist of syncophancy. Obviously this isn't good or healthy, but it's not wrong or nefarious. It's certainly not an America-only phenomenon. |