[mike_hearn]

LLMs don't model reality, they model the training data. They always reflect that. To measure how closely the training data aligns with reality you'd have to use a different metric, like by putting LLMs into prediction markets.

The main issue with economics is going to be like with any field, it'll be dominated by academic output because they create so much of the public domain material. The economics texts that align closest with reality are going to be found mostly in private datasets inside investment banks, hedge funds etc, i.e. places where being wrong matters, but model companies can't train on those.