[username223]

Does it matter? The frontier models stole the whole internet, then the second-level models stole from them… It’s all theft.

[ghshephard]

Oh - I 100% could not care less regarding the morality/legality/whatever... Everyone trains on everything.

I'm just wondering if the smaller labs see the same velocity of advances without SOTA models to generate Terabytes of training data?

[qudat]

Hard agree.

[timfsu]

The question is - if the SOTA model disappear - do these follow-on models have the ability to improve themselves without distillation?

[andsoitis]

> The frontier models stole the whole internet

What does that even mean?