Literature
|
Author: Thomas M. Cover and Joy A. Thomas Available e.g.: amazon.com, bokus.com, adlibris.com, cdon.com. |
Complementary material by Stefan Höst (First draft)
InfoTheoryPart1.pdf (Probability, Information and Source coding theorem)
InfoTheoryPart1b.pdf (Kraft)
InfoTheoryPart1c.pdf (Huffman)
InfoTheoryPart2a.pdf (LZ)
InfoTheoryPart2b.pdf (Channel capacity and coding)
InfoTheoryPart2c.pdf (Differential entropy)[will probably not be ready during the course]
InfoTheoryPart2d.pdf (Gaussian channel)
Papers (from IEEE Explore)
- J. Ziv and A. Lempel, A Universal Algorithm for Sequential Data Compression, IEEE Trans. on Info. Theory, Vol. IT-23, no. 3, May 1977.
- J. Ziv and A. Lempel, Compression of Individual Sequences via Variable-Rate Coding, IEEE Trans. on Info. Theory, Vol. IT-24, no. 5, Sept 1978.
- T. Welch, A Technique for High Performance Data Compression, IEEE Computer, June 1984.
Other books and articles of interest (free download):
- Claude E. Shannon, A Mathematical Theory of Communication. Bell System Technical Journal, vol. 27, pp. 379-423 and 623-656, July and October, 1948.
- R. V. L. Hartley, Transmission of Information. Bell System Technical Journal, July 1928
- James L. Massey, Lecture Notes: Applied Digital Information Theory I and II.
- David J.C. MacKay, Information Theory, Inference, and Learning Algorithms.
- Robert M. Gray, Entropy and Information Theory.
- Biography of Claude Elwood Shannon
Or watch: