|
|
|
|
|
by jerf
5185 days ago
|
|
Entropy is relative to your encoding scheme plus or minus a constant. Usually you can ignore this fact when dealing with large amounts of information, because almost all human-interesting encoding schemes are related by relatively small constants, but when handed a small set of numbers it suddenly dominates as the constant for very reasonable schemes relative to other very reasonable schemes can exceed the size of the bits given to you in the form of the original numbers. This argument basically collapses back down to, no, there still isn't enough information in a short sequence to identify the next number truly uniquely. |
|
[1]http://en.wikipedia.org/wiki/Kolmogorov_complexity I didn't use the term because I didn't think most people would recognize it, but we're getting technical now.