Lectures
There are 13 lectures in the course, given by Stefan Höst in E:2311 (15-17), and 7 exercises, given by Umar Farooq, scheduled in E:4116 (15-17). Below is a preliminary lecture plan with problems connected to each lecture.
Solutions to problems: Solutions.pdf.
This is a preliminary planing, and it might change along the course:
Cal week | Lecture | Topic | Part in book |
12 | L1 20/3 | Information measures | 3.1-3.2 |
L2 22/3 | Properties of information measures | 3.2-3.3 | |
E1 23/3 | (2.1-2.6), 3.3-3.11, 3.14-3.16 | ||
13 | L3 27/3 | Optimal source coding and Kraft inequality | 4.1-4.2 |
L4 29/3 | Huffman coding | 4.3 | |
E2 30/3 | 4.1-4.3, 4.5-4.8, 4.10, 4.11 | ||
14 | L5 3/4 | Information measures for processes | 3.4 |
L6 5/4 | LZ codes | 5.2 | |
E3 6/3 | 3.20-3.22, 3.24, 5.1, 5.3-5.5. Problem3-20.pdf | ||
15 | Eastern | ||
16 | Retake exam week | ||
17 | L7 24/4 | AEP and its consequences | 6.1-6.2 |
L8 26/4 | Capacity for DMC | 6.3-6.5 | |
E4 27/4 | 6.1-6.3, 6.5, 6.7, 6.8, 6.10, 6.11, 6.13a, 6.14 | ||
18 | L9 2/5 | Channel coding | 7.1-7.2 |
L10 3/5 | Information measures for continuous variables | 8.1-8.2 | |
E5 4/5 | 7-.1-7.3, 8.1-8.7 (Solution 8.5) | ||
19 | L11 8/5 | Gaussian channel | 9.1-9.3 |
L12 10/5 | Discrete input Gaussian channel | 10.1-10.4 | |
E6 11/5 | 9.2-9.5, 10.1-10.4 | ||
20 | L13 15/5 | OFDM, MIMO | 9.2-9.3 |
E7 18/5 | 9.6, 10.5, 10.7 |
New or updated material in 2017 edition:
n-dimensional Gaussian distribution: InfoTheory2016-nDimGauss.pdf
Capacity for MIMO channel: InfoTheory2016-MIMO.pdf