[ben_w]

Even monolithic training runs take sources more disparate than any human has the capacity to consume.

Also, given the lack of imagination everyone has with naming places, I had to check:

https://en.wikipedia.org/wiki/Moscow_(disambiguation)

[stoniejohnson]

I was responding to the idea that an LLM would believe (regurgitate) untrue things if you pretrained them on untrue things. I wasn't making a claim about SOTA models with gigantic training corpora.