[skybrian]

A basic difference is that search engines don't make up fictional links, quotes, and citations.(Though they often index web pages that are bullshit.)

"Fill in the blank" training results in a model that guesses when it doesn't know the answer. You need some different kind of training or architecture to get nonfiction.

This turned out to be a great demo for demonstrating what a large language model can't do, because people expect nonfiction for scientific papers, making the bullshitting stand out more.