[dchest]

LlaMa was trained on 78 GB of StackExchange (I assume StackOverflow was included in that).

[int_19h]

But was it parsed and reformatted specifically in the "chat format" (i.e. the same as inputs later fed to the model when used as a chatbot)? It can make a surprisingly big difference.