Information Theory
Course 0000001589 in WS 2022/3
General Data
| Course Type | lecture with integrated exercises |
|---|---|
| Semester Weekly Hours | 5 SWS |
| Organisational Unit | Chair of Communications Engineering (Prof. Kramer) |
| Lecturers |
Emna Ben Yacoub Vladlen Galetsky Gerhard Kramer Assistants: Constantin Runge |
| Dates |
Mon, 13:15–14:45, 1180 Fri, 09:45–12:30, N0314 and 1 singular or moved dates |
Assignment to Modules
-
EI70350: Information Theory (Information Theory) / Information Theory (Information Theory)
This module is included in the following catalogs:- Catalogue of non-physics elective courses
Further Information
Courses are together with exams the building blocks for modules. Please keep in mind that information on the contents, learning outcomes and, especially examination conditions are given on the module level only – see section "Assignment to Modules" above.
| additional remarks | Review of probability theory. Information theory for discrete and continuous variables: entropy, informational divergence, mutual information, inequalities. Coding of memoryless sources: rooted trees with probabilities, Kraft inequality, entropy bounds on source coding, Huffman codes, Tunstall codes. Coding of stationary sources: entropy bounds, Elias code for the positive integers, Elias-Willems universal source coding, hidden finite-memory sources. Channel coding: memoryless channels, block and bit error probability, random coding, converse, binary symmetric channel, binary erasure channel, symmetric channels, real and complex AWGN channels, parallel and vector AWGN channels, source and channel coding. |
|---|---|
| Links |
E-Learning course (e. g. Moodle) TUMonline entry |
Equivalent Courses (e. g. in other semesters)
| Semester | Title | Lecturers | Dates |
|---|---|---|---|
| WS 2023/4 | Information Theory |
Ben Yacoub, E.
Kramer, G.
Assistants: Runge, C. |
Mon, 13:15–14:45, 1180 Fri, 09:45–12:30, N0314 |
| WS 2021/2 | Information Theory |
Ben Yacoub, E.
Kramer, G.
Steiner, F.
Assistants: Deppe, C. |
Mon, 13:15–14:45, 0.001 Tue, 15:00–16:30, 0980 Tue, 16:45–17:30, 2770 |
| WS 2020/1 | Information Theory |
Ben Yacoub, E.
Kramer, G.
Steiner, F.
Assistants: Deppe, C. |
|
| WS 2019/20 | Information Theory |
Ben Yacoub, E.
Kramer, G.
Steiner, F.
Assistants: Deppe, C. |
|
| WS 2018/9 | Information Theory | Kramer, G. Steiner, F. | |
| WS 2017/8 | Information Theory | ||
| WS 2016/7 | Information Theory |