[rjh29]

Spam is already easily generated so AI won't change that.

Misinformation and manipulation is based on a small number of posts being shared and upvoted en masse, so AI won't help there.

However, social hacking and fraud involving actual dialogues with people is currently labour intensive and low yield. AI will definitely enable more of those attacks to happen automatically; and conversely, also help anti-fraud companies create puppet accounts to waste the fraudster's time, and thus the game of cat and mouse continues.

[ithkuil]

The key difference is that LLMs will allow an unforeseen degree of interactive and custom spam that will feel less and less like spam and more and more like a natural and even useful interaction, until you just realize it was an elaborate scheme to subtly increase your preference for brand A over brand B

[AstralStorm]

Or it will still end up in a bin called statistical spam filter.

It's relatively easy to detect when someone is trying to sell you something. Does not matter if it's a custom written text or not. We had the true spam filters going 2 nines accurate already. (Google's is somehow misgauging spam or not learning my particular mix of spam well.)

[rjh29]

LLMs can also be used to identify spam, not by language, but by the actual intent and "is this email something I want to read".

Open question: is there any case where LLMs can be used for malicious purposes, but LLMs can't be used to defend against it?

[ithkuil]

> LLMs can also be used to identify spam

It will be fun to watch the arms race where the spam generator need to conceal prompt injection attacks meant to circumvent such filters while at the same time be too subtle for a humans to pick up