[torginus]

Except everything that comes out of an LLM (like GPT4) is highly suspect (at least in my experience).

[samus]

1. They need it for style and language, not necessarily for the facts

2. Since GPT-4 is seen as the very best general-purpose LLM in existence, it makes sense to emulate its performance with less resources.

3. Phi models are also trained with other high-quality data