[BobbyTables2]

LLMs will invent all those things without even being asked.

Especially on topics for which there is little data or few sources.

Ask it a really specialized question - the kind of domain-specialized topic not openly and extensively published. Something post-doctoral research equivalent.

It will happily invent all the details. Then if you ask to confirm if those things actually exist, it will apologize and say they do not.

To be blunt, LLMs only seem intelligent because they were trained on moderate intelligence publications and people mainly ask low intelligence questions.