Hacker News new | ask | show | jobs
by insanitybit 8 days ago
Are you missing the comment that I'd responded to?

> Information entropy. The amount of data an LLM ingests cannot be compressed to the size of the weights even at maximum theoretical compression.

1 comments

I wrote that comment. As I said, an LLM's weights are less than the size of theoretical compression, therefore what LLM training is doing is not compression at all.
I can't believe I have to say this again? Information theory is completely irrelevant to copyright.
At this point I believe you are willfully misunderstanding the argument, based on your other comments saying you don't understand, repeatedly, so I can't believe you have to say it again either.
k