[weregiraffe]

Why would the gap grow? There is no more training data to acquire, frontier model are training on the entire internet. Everything from now on is just fine-tuning.

[kvam]

Your statement assumes training data is the only thing that matters for the big players, while not considering it limiting for the small Norwegian model. That’s a fallacy.

[weregiraffe]

Nowhere in the article does it say the Norwegian LLM will train _only_ on Norwegian data.

[xadhominemx]

Orders of magnitude less compute for pre- and post-training than the the frontier labs.