Hacker News new | ask | show | jobs
by nostradumbasp 503 days ago
It's definitely not looking good. Now that we have more open source models, for better and for worse, we have to worry about politically motivated amateur's and vigilantes too.
2 comments

The most dangerous use of deepfakes is the workflow for manipulating those kinds of people.
Mostly agree. We all know how awful swatting has been for many victims. Also personalized scams and deception at scale. I also worry about homebrew automated weaponry used for cowardly terroristic purposes and how that could imaginably be around the corner. It's a pretty scary topic to consider the depths of what can be done by individuals using these tools without regulations.
That was always a risk for justice in calling witnesses.
It's a little different now. Someone can deepfake or even face swap videos/images/audio and send an angry mob to someones house. Or be convinced to handle matters themselves...

"Pictures/videographic evidence doesn't lie" isn't as true now as it was 30 years ago at the amateur level. Especially with coercion and human flaws.

It lied then too. Darkroom magic is how we got star wars to look like star wars and not people standing on a plywood ledge.
It couldn't lie at scale though. The amount of effort it took to doctor someones face believably onto film in the star wars era was tremendous. Now it can be done on the terabyte per second scale in an individualized fashion.

Ring camera feed could show your actually nice neighbor kicking your dog. Could show a lowly employee that pissed off a manager stealing the company stapler. Could show a spouse having an affair, fake messages (one of the highest incidents of murder in the US is due to this). Swatting on a new level by impersonating your voice. All of these are things a somewhat motivated highschooler can now do.

Imagine what an agency or enterprise could do? Especially if they intercepted your network activity to turn you into any level of puppy kicker you could imagine because of your politics, your position, or for testing out the success rate of such a program.