This is the preliminary contents of the lectures and corresponding course material.
| # |
Subject(s) |
Material |
Videos |
| 1 |
Introduction. Random source models. Source coding theory. |
Slides for lecture 1
Markov source order 1
Markov source order 2
Instantaneous codes |
Sources, Markov models
Random modelling
Source coding |
| 2 |
Source coding. Information theory. |
Slides for lecture 2
Same Markov examples as lecture 1. |
Kraft's inequality
Mean data rate, entropy bound
Information theory |
| 3 |
Optimal codes. Huffman coding. |
Slides for lecture 3 |
Optimal codes
Huffman codes
Extended Huffman codes
Extra information
Constructing codes from lengths (coming) |
| 4 |
Adaptive Huffman coding. Run-length coding. Golomb codes. Exp-Golomb codes. |
Slides for lecture 4
Suitable distributions for Golomb and Exp-Golomb codes |
Adaptive Huffman coding (coming)
Monotone distributions, Unary code
Golomb codes
Exp-Golomb codes
Image coding examples |
| 5 |
Arithmetic coding. |
Slides for lecture 5-6 (pages 1-17)
Arithmetic coding example, exact calculations
Arithmetic coding example, Markov source
Arithmetic coding example, fixed point
|
Shannon-Fano-Elias coding
Arithmetic coding, infinite precision
Arithmetic coding, finite precision |
| 6 |
Adaptive arithmetic coding. ppm. Binary arithmetic coding. |
Slides for lecture 5-6 (pages 18-38) |
Adaptive arithmetic coding
PPM (coming)
Binary arithmetic coding (coming) |
| 7 |
Lempel-Ziv coding. |
Slides for lecture 7 |
Lempel-Ziv coding: LZ77, LZSS, DEFLATE
Lempel-Ziv coding: LZ78, LZW |
| 8 |
Burrows-Wheeler's block transform. Tunstall codes. |
Slides for lecture 8 |
Burrows-Wheeler's transform
Tunstall coding |
| 9 |
Differential entropy. Rate-distortion theory. |
Slides for lecture 9 |
Differential entropy
Rate-distortion theory |
| 10 |
Looking forward: Lossy transform coding. |
Slides for lecture 10 |
No videos for this lecture |