|
|
|
|
|
by EncomLab
427 days ago
|
|
"Complexity" is a hugely problematic term when used in this way - remember that entropy and complexity are related, but they are not interchangeable. A complex system can have lower entropy than a simpler system, and conversely, a system can have high entropy but be relatively simple. By mingling these terms without specifying objective reference points, it all just comes out as word salad. This paper just reads like an attempt at sounding smart while actually saying little. |
|
Good examples of these are anything that Kolmogorov-compresses well. For example, by almost any measure the output of a pseudo random number generator has high entropy. Yet it has low information density (low complexity), as the program that generates the sequence, plus its state, is really small.