[zamalek]

> with AI-generated content excluded from pre-training.

Though this is largely impossible these days, unless they pre-trained on pre-AI era data.

[stymaar]

That could be. Just use pre-training for language understanding and let the post-training on synthetic data do the heavy lifting.