[latexr]

It will first lead to a world where fake videos of celebrities will be used to scam you, and your own voice will be used to scam your relatives. Both of those are happening today.

Ironically, this will lead to a work where we need to use these fake personas online to not have our lives messed with offline.

I don’t fully agree with your first paragraph, but I do agree with the second one.

[Ukv]

> and your own voice will be used to scam your relatives. Both of those are happening today.

I can't really see it becoming common for cold-calls that pretend to be someone the victim knows (like the terrifying ransom calls), since the operations work at a huge scale expecting most people to not even pick up a "scam likely" call. Even given free and instant model tuning, just having to find voice clips of the person prior to each unanswered automated call seems like it would tank the quantity they're able to make.

I imagine there will be plenty of unevidenced claims that this is what scammers did to them though. Victims have always said "it sounded exactly like him/her", and from there it's more comforting for someone to conclude they must've been fooled by a sophisticated attack rather than something simple.

For more targetted phishing, like pretending to be a company's CEO and phoning employees to get access, I could definitely see it being used. I think we're probably going to have to move "person sounds like boss over the phone" from "plausible to fake" to "trivial to fake".

[latexr]

> just having to find voice clips of the person

You can clone a voice from a clip which is under 5 seconds.

https://www.pcmag.com/news/microsofts-ai-program-can-clone-y...

All you need is a short spam call and you’re done before you even realise anything is happening. Or grab some video out of Facebook since you’ll have the family connections right there for the taking.

[Ukv]

There's no human in the process (to be trawling through Facebook pages looking for videos where relatives speak) prior to the victim picking up - and even then often not until the victim has replied to some initial hook. The huge number of phones being automatically rang doesn't permit it, as far as I can tell.