[BoredomIsFun]

> especially base ones

Did you actually try them? I did.They generated even more "slopey" text than instruction-tuned ones.

[skinfaxi]

But was it content indistinguishable from someone learning the language being used, for instance?