Information Theory (Information Theory)
This module handbook serves to describe contents, learning outcome, methods and examination type as well as linking to current dates for courses and module examination in the respective sections.
Module version of WS 2020/1 (current)
There are historic module descriptions of this module. A module description is valid until replaced by a newer one.
Whether the module’s courses are offered during a specific semester is listed in the section Courses, Learning and Teaching Methods and Literature below.
|available module versions|
|WS 2020/1||SS 2020|
EI70350 is a semester module in English language at Master’s level which is offered in winter semester.
This Module is included in the following catalogues within the study programs in physics.
- Catalogue of non-physics elective courses
|Total workload||Contact hours||Credits (ECTS)|
|150 h||75 h||5 CP|
Content, Learning Outcome and Preconditions
Source coding: Discrete Memoryless Sources, Prefix-Free codes, Shannon-Fano codes, Huffman codes, Tunstall codes, Discrete Stationary Sources, Elias-Willems universal souce coding. Typical sequences and sets. Channel coding: Discrete Memoryless Channnels, Capacity. Relative entropy and additive white Gaussian noise channels.
• Explain the basic quantities of information theory, i.e., entropy, mutual information, informational divergence,
• Explain important properties of these quantities, e.g., chain rule, bounds, convexity
• Apply information theory to measure the quality of the processing blocks (e.g., data compression, channel coding) of a digital transmitter and receiver, and the quality of the channel (capacity)
• Understand scientific documents in information theory.
Courses, Learning and Teaching Methods and Literature
Courses and Schedule
Ben Yacoub, E.
Assistants: Runge, C.
Mon, 13:15–14:45, 1180
Fri, 09:45–12:30, N0314
and singular or moved dates
Learning and Teaching Methods
The students are instructed in an explorative teaching style. In the tutorials students discuss with the tutor exemplary implementation of codes introduced during the lecture, e.g. for current wirless mobile communictaion systems, and why certain coding schemes are used for certain applications.
- Problem sheets
- Presentation slides
- Cover, T., Thomas, J.: Elements of Information Theory, Wiley-Interscience; 2nd edition
Description of exams and course work
There is a possibility to take the exam in the following semester.
Current exam dates
Currently TUMonline lists the following exam dates. In addition to the general information above please refer to the current information given during the course.