[mosura]

What of the costs for creating the data that was used to train the model being distilled?

[yandie]

At least 1.5B by stealing books, per a recent ruling.

I don’t feel sorry for the model companies

[mosura]

They only had to pay for storing the books on a server for later possible use. They did not have to pay anything for the training which was declared fair use.

[nonethewiser]

This actually undermines the argument that distilling is harmless because its founded on the idea that Anthropic did the same thing and didn’t have any repercussions.

[applicative]

Do you people seriously believe that Moonshot and the Chinese personal-cult-state dont possess and train on the same torrents?

[mosura]

They aren’t hypocritically crying foul about it, so no we don’t care if they do.

[nonethewiser]

Well of course. But they dont hate Chinese model companies.