Elements of Information Theory — Cover & Thomas

Thomas M. Cover and Joy A. Thomas, 2nd Edition (Wiley)

The standard graduate reference for information theory: entropy, mutual information, data compression, channel capacity, rate-distortion theory, and connections to probability and statistics.

Chapters

Exercises added as I work through each chapter.