[Springtime]

There's evidence various third-party models (including Deepseek) used distilling in training, based on models from those leading services. So they have more flexibility with pricing.

[malnourish]

Is that fundamentally any different than what e.g., Meta and OpenAI have done?

Besides, hasn't SCotUS ruled that raw LLM output isn't subject to copyright? So these companies would be breaking a ToS at worst.

[behnamoh]

So? And Anthropic/OpenAI literally stole copyrighted content to train their models.

[Springtime]

The point was that distilling based on others' models for training means they're not spending the same amount on R&D and/or training, giving them headroom in other ways (responding to the parent's point). It wasn't a comment reflecting on copyright/fair use.

[behnamoh]

In the same fashion, Anthropic/OpenAI also reduced their training cost by not purchasing the license to copyrighted work and stealing it instead.