[knaik94]

I think we are closest to the complete destruction of what it means to have your identity stolen. Deep fakes were the beginning and now they are reaching mainstream movie/tv use for final shots. Voice cloning exists, but has mostly only cloned celebrity voices.

LLM fine tuning on consumer hardware is not reasonable right now, but it will be soon. And cloud computing is expensive but will get you results.

I think we're going to see a problem with AI "impersonating" people. Sometimes it will be used for scams, other times porn, but the case that feels most dystopian is using it on Ex partners or dead people. Both situations have different motivations, but amount to essentially the same thing. Training AI on the likeness of someone in a way that violates their personal boundaries.

People have already become attached to AI chatbots and used things like Replika AI to become surrogate relationships. I think most people underestimate how likely it is for a human to make a unhealthy bond to AI despite knowing it's an AI. I feel like with other things, like deepfakes, you can at least fact check to some degree.

I don't know how to feel about the idea of someone making an AI of themselves intentionally in order to make money in some way. The issue of consent goes away, but that opens up a question of responsibility. Chat logs with past partners is unfortunately a rich source of training data. How far can revoking consent extend if someone is using information that was consensually and willingly given to them. How many people would actually respect those kinds of boundaries when in a very vulnerable and hurt state after a breakup. I don't like the answer that thought exercise leads me to.