[thegeomaster]

You could think of supervised learning as learning against a known ground truth, which pretraining certainly is.

[Davidzheng]

a large number of breakthroughs in AI are based on turning unsupervised learning into supervised learning (alphazero style MCTS as policy improvers are also like this). So the confusion is kind of intrinsic.