Lectures
There are 13 lectures in the course, given by Stefan Höst, and 7 exercises by Eduardo Medeiros. All but one are scheduled in E:2517.
Below is a preliminary lecture plan with problems connected to each lecture. The problem numbers listed below refere to problems in the file Problems.pdf. Solutions for problems in Chapter 9.11: Problems2015-SolutionsCh9-11.pdf.
Might change along the course:
Cal week | Lecture | Topic | Part in book |
13 | L1 23/3 | Information measure | 3.1-3.2 |
L2 25/3 | Properties of information measure | 3.2-3.3 | |
E1 26/3 | (2.1-2.5), 3.1, 3.3-3.11,3.15-3.17, 3.19 | ||
14 | L3 30/3 |
Entropy rate, Markov sources and Source coding |
3.4, 4.1 |
L4 1/4 | Optimal source coding and Huffman codes | 4.2-4.3 | |
15 | E2 7/4 | 3.20-3.22, 4.1-4.5 | |
L5 8/4 | Huffman code & LZ codes | 4.3, 5.2 | |
16 | L6 13/4 | AEP and its consequences | 6.1-6.2 |
E3 14/4 | 4.6, 4.7, 4.10-4.12, 5.1-5.4 | ||
L7 15/4 | Capacity for DMC | 6.3-6.5 | |
17 | E4 22/4 | 6.1, 6.2, 6.4-6.8, 6.10, 6.11, 6.13 | |
18 | L8 27/4 | Channel coding | 7.1-7.2 |
L9 28/4 | Differential entropy | 8.1-8.2 | |
E5 29/4 | 7.1-7.3, (7.6), 8.1-8.5, 8.7 | ||
19 | Re-take exams | ||
20 | L10 11/5 | Gaussian channel | 9.1-9.2 |
21 | L11 18/5 | Shannon's fundamental limit | 9.3 |
E6 19/5 | 9.1, 9.2, 9.3, 9.4, 9.5 | ||
L12 20/5 | Discrete input Gaussian channel | 10.1-10.4 | |
22 | L13 25/5 | Rate distortion | 11.1-11.3 |
E7 26/5 | 7.4, 10.1-10.4, (10.5), 10.6, 11.1, 11.4, 11.5 |
Complementary material to 2014 edition: