[random_moonwalk]

The fundamentals of Information Theory via (the late) David Mackay's lectures and textbook (homepage with links to the videos and free online textbook here: http://www.inference.org.uk/itprnn/).

[shoo]

Mackay's information theory text book is wonderful.