Hacker News new | ask | show | jobs
by otabdeveloper4 977 days ago
The LLM isn't creating new information, only packaging existing information.
1 comments

When it creates a poem, song, essay, painting, or program that has never existed before, it is doing what we do. Whether or not we define that as "creating new information" is not an especially interesting question at the end of the day.
No, because what matters here is if information complexity (aka entropy) is being increased.

Humans increase it, LLMs decrease it.

This matters because eventually in the future information complexity will be humankind's only valuable resource.

(So humans create value, LLMs destroy it.)

(Shrug) If you want to increase entropy, just call rand().

You might take a bit of time to learn what you're talking about before posting, or at least before forming permanent opinions on the subject. It's fascinating stuff, trust me... and I'm not that much farther along than you are, trust me on that as well.