[yorwba]

They train on 14 billion tokens in Slovene. Are you sure that's not enough?

[miros_love]

Unfortunately, yes.

We need more tokens, more variety of topics in texts and more complexity.

[mdp2021]

We need one-shot learning.

(That amount is equivalent to 50000 books, which few nationals will have read.)