[dawatchusay]

This is exactly an existing concern: flood the internet with LLM-generated disinformation, future LLMs get trained on it, those LLMs flood the internet with disinformation, the cycle repeats. This is why it’s a problem that LLMs can’t distinguish fact from fiction

[squigz]

Interestingly, you could replace "LLM" with "human" in this comment and it still makes sense.

[richiebful1]

Were humans ever good at identifying misinformation? In the US, we effectively started a war with Spain in 1898 because of newspaper propaganda

[aleph_minus_one]

> Were humans ever good at identifying misinformation?

On the other hand: if both

- the AI becomes good at identifying misinformation

- the AI is opposed to spreading misinformation

it will become a serious threat to those in power. So this won't happen.