Hacker News new | ask | show | jobs
by SiempreViernes 8 days ago
Is it? I'd expect most of the training set to be synthetic data extrapolated from a small set of human authored texts.
1 comments

Most of the training set is half of the Internet. LLMs are pre-trained on general set of human biases and patterns of thinking.