[alwayslikethis]

Realistically the most difficult part of training a LLM is curating a good data set. OpenAI never published their training data.