|
|
|
|
|
|
by mturmon
582 days ago
|
|
|
This is what I learned as the “theory of types” from Cover and Thomas, chapter 11, from original work by Imre Csiszar. See just under “theorem 6” in https://web.stanford.edu/class/ee376a/files/2017-18/lecture_... The key (which is not in OP) is not the construction of E log(p), but in being able to prove that the “typical set” exists (with arbitrarily high probability), and that the entropy is its size. |
|
|