Actually:
https://www.wired.com/story/openai-ceo-sam-altman-the-age-of...
At the MIT event, Altman was asked if training GPT-4 cost $100 million; he replied, “It’s more than that.”
Granted, OP did say pre-training.