Hacker News new | ask | show | jobs
by mtgp1000 2155 days ago
Define misuse.
2 comments

One obvious example would be to fully automate social engineering email scams. Imagine how much disruption it would cause if spearphishing became as common as robocalls have become post-automation.
Wouldn't the same AI be able to detect that the text was generated by itself ?
If it became that common it would quickly cease to be that effective. Spearfishing works because it's rare, so it doesn't automatically set off your bullshit detector. Most people don't fall for "cheap vi@gra" emails anymore.

Social engineering in general is effective because it's rare enough that people don't feel the need to develop policies and strategies for preventing it.

Sure, but there's no reason to expect the required strategies to be non-disruptive. It's now impossible for anyone not on my contact list to call me, because I won't pick up or listen to their messages - it'd be a tragedy if email became similarly locked down.
For example, convincing and hard to detect fake content generation on Facebook/reddit/etc