Nobody's shown a way yet to teach a computer how to tell bullshit from facts and filter out the bullshit in it's regurgitation/hallucination text creation stuff.
So until that happens, all you've done is let people put bullshit-spewing humans in more places. People already know not to necessarily trust humans, now they'll (re)learn that about computer generated text. (It's actually probably not clear to everyone what's computer-generated text and human-generated text, so more likely, specific places that rely on this will just be seen as untrustworthy. "Create more untrustworthy sources of text" is... underwhelming, honestly.)
> Nobody's shown a way yet to teach a computer how to tell bullshit from facts and filter out the bullshit in it's regurgitation/hallucination text creation stuff.
And yet they keep improving at every iteration. Also, keep in mind that this objection will exist even if these AI get near omniscience. People disagree with facts all the time, usually for political motives. Therefore your type of criticism won't ever be settled.
I've said this before but these people are going to be shouting that 'the AI doesn't really understand the world' right up until the moment a nanobot swam dissolves them into goop for processing.