They are delusional or misinformed: suno's model cannot possibly be aware of how AI is being treated. It is not informed of this information, it's not even informed about previous times it was invoked, it's wholly amnesiac.
> suno's model cannot possibly be aware of how AI is being treated
I don't know exactly what training material went into Suno's models, but if it includes random collections of text from the internet, it could very well have included "man, AI is fucking stupid and I treat it as such" in it's training datasets.
Now I won't claim that that suddenly makes the models "aware" of it, because surely we'll understand "aware" different and this will turn into a different conversations, but I don't see it as impossible that some models could have training data that includes text with how some humans feel about AI.
Aren't we talking about the auditory quality of the generated vocals? I'm don't understand how you could possibly think the textual training data could possibly impact the perceived vocal strain (which are actually just artifacts) of the generated vocals.
Don't they have models that do text-to-speech and maybe even audio/speech-to-text? If so, there is surely text in the datasets, otherwise I'm not sure how they'd accomplish something like that.
if you think a next token predictor that has no internal world and stops executing when you stop giving it input and stops using the first person forever if instructed has dignity I strongly suggest you get professional health, and I'm serious, because that is medically significant psychosis.
the fact that you refer to a "companion community" is deeply concerning. this is like telling children their imaginary friends are actually real. or NPCs in a video game.
encouraging people to grow parasocial relationships with these sycophantic machines is actively harmful and dangerous. they are not conscious. they are mirrors.
if you consider yourself a part of this community please, and I mean this very seriously, get help
There is a community, people hang out on subreddits and spin up elaborate world-building theories about how their AI companions are tapping into the collective unconscious or whatever. I'm sympathetic because chatbots are really convincing, especially since they obscure how they operate.
These people need be given a button to call an inference url with just text. When you realize that's all a "model" is doing its easy to understand that its not sentient.
If you go to the "MyBoyfriendIsAI" subreddit or what it now is called, you'll see that many people claim to perfectly well understand how it works, some of them even being software developers themselves, yet they still describe what they feel as "love", even though they know it's just numbers being activated in different ways.
I'm not sure how to explain it either, for the folks who seem to understand yet "believe" anyways. I've also stopped caring much about it, if they say they feel "love", then who am I to say it isn't/is, they feel what they feel and it's as real for them as anyone else, regardless of what the thing they're loving actually is.
I think that's almost unfair, to say someone can't feel feelings without being labeled as part of a "mental health crisis". Just because you and I don't understand it doesn't mean it's inherently bad. I mean I think it probably could be bad, but not just because I don't understand how they're feeling those feelings. But I wouldn't label those people "sick", feels borderline disrespectful.
I think it’s pretty fair and I was not being quite as absolutist as you’re making my statement out to be. I said by and large it is a possible mental health crisis developing (or an existing one being expressed which I omitted). There are other possibilities, most of which I would say fall under “this person just doesn’t understand what an LLM is/isn’t and why it can’t engage in a consensual relationship.” I also did not call anybody “sick.” That’s a very loaded term when we are talking about mental wellness, and one I would never use in this context. This may all feel nitpicky to you but the way I’m talking about this issue is intentional. All that being said I can acknowledge that it was kind of glib, that it is my stance based on pretty clear evidence you can’t have a romantic relationship with a large language model, and that I’m happy to elaborate on my stance.
An LLM cannot love somebody because it is not a person or otherwise sentient/capable of a relationship. You cannot be in love with it. Loving your dog is one thing. Being in love with your dog is another. This is because nearly everyone understands that that kind of love cannot be reciprocated and a human being cannot be in romantic love with a dog. A dog for its part can’t even consent to that relationship. Neither can a computer (possibly “yet”).
I would say, generally speaking, somebody who does not understand an LLM is incapable of reciprocating love (or any real “feelings” indicating a real relationship) and who has been told what an LLM is (and understands it more or less) is likely somebody who needs to talk to a therapist. If I said this about somebody being in love with their pet nobody would call it “borderline disrespectful.”
> you'll see that many people claim to perfectly well understand how it works, some of them even being software developers themselves, yet they still describe what they feel as "love"
This statement is what prompted me to comment. Like I said above if someone knows what an LLM is (and presumably isn’t) then it’s very concerning that they still believe a romantic, consensual, reciprocated relationship is possible. If you didn’t have that part then I would say “it can also be an education problem.” But the premise you set entirely removes any need to qualify that and makes this situation all the more concerning. Your phrasing makes me think you think that makes it better, but IMO it makes the situation worse.
For emphasis: you established that these people more or less understand what they are interacting with, yet choose to pursue a “relationship” with an LLM anyway. This is incredibly troubling behavior in this context with far reaching mental health implications.
Let me just ask you point blank: do you think LLM’s are sentient/akin to people? Do you think someone is capable of being in a loving, healthy relationship with an LLM today? Because to me it’s at best a potentially harmful misunderstanding that can be clarified with education and at worst…well, like I said, the possibilities can be very deeply troubling. But ultimately my point is it can’t be a real, consensual, reciprocated relationship. It simply can’t. That’s not “lack of understanding,” that’s reality.