[jzombie]

> LLMs don't increase information complexity in any way.

False.

LLMs can synthesize and combine information from their training data and generate new insights, ideas, and expressions that weren't explicitly present in the training data.

This adds layers of interpretation, inference, and creativity that enhance the complexity of the information they produce.

[otabdeveloper4]

The word "information" here has a strict mathematical definition, and LLMs decrease the amount of information. This decreasing is, in fact, the very thing that makes an LLM an LLM. Their function is to remove and simplify information, leaving only the most significant variables.

[jzombie]

Is your function to also remove and simplify information? I ask because that seems like a pretty simple explanation. I was trying to study ML, but think I should just read children's books, or maybe not even read at all.