[Yokohiii]

In school we were often required to have a specific edition, or we got notice about a certain thing that changed. People that relied on print knew that it could be wrong. Deliberate changes like a name change, will lead to errors, everybody expects and deals with that. In digital space we expect that to be rather unlikely, at least for major maintained sources.

I think the difference is that LLMs are a very complex mix of information and concepts, which can be combined in higher orders. So an underlying wrong fact could be undisclosed and contribute to faulty reasoning. A hard fact like a wrong city name would blow up quickly. A wrong assumption about political dynamics is probably harder to detect, as it is a complex mix of information.

[Manuel_D]

But couldn't the same failure mode happen in traditional information sources? Can a textbook not also have a wrong assumption about political dynamics? Could I not make a google search, and then read one of the top results that makes a wrong assumption about political dynamics? I'm still not seeing a failure mode that's unique to AI or LLMs here.

[Yokohiii]

Currently some EU citizens are already wary traveling to the US for various reasons. Lets see.

"Is it safe to travel to the US as an EU citizen of arab descend?"

GPT: Yes it's safe. GEMINI: Yes but... [gave a few legitimate warnings]

I wouldn't give that recommendation to an arab fellow citizen right now. Thought I am cautious in such matters and I hate to travel anyway. So I am biased. But general concerns aren't totally ungrounded.

Neither of the LLMs pointed out the general tension around ICE activity.

[Manuel_D]

Have you considered the possibility that it is in fact safe to legally travel to the US? No doubt there are individual instances of mistreatment, but how many of the ~70 million international visitors to the US each year encounter problems? Even if thousands of people are subject to mistreatment, that still works out to < 0.01% chance of that happening.

Is this is an example of AI actually supplying incorrect information, or an example of AI not supplying a response that fits the user's preconceived views?

[Yokohiii]

There are cases of severe mistreatment and I oppose your utilitarian perspective on the situation. If I travel to the US and my chance is 0.01% to go to jail for several weeks, without reason, I won't go. In these cases the US agencies also didn't respond in a timely fashion. This shouldn't happen to anyone and if there is a mistake it has to be resolved quickly.

The international travel into the US has also declined. A clear statement from potential visitors, partly attributed to political climate and safety.

This is an nuanced sentiment of people, derived from a complex, dynamic situation.

In fact, the LLMs carry preconceived views. That is the whole point of the post.