Markov Processes

Module MA4408

This Module is offered by Department of Mathematics.

This module handbook serves to describe contents, learning outcome, methods and examination type as well as linking to current dates for courses and module examination in the respective sections.

Module version of SS 2014 (current)

There are historic module descriptions of this module. A module description is valid until replaced by a newer one.

Whether the module’s courses are offered during a specific semester is listed in the section Courses, Learning and Teaching Methods and Literature below.

available module versions
SS 2014	WS 2013/4	SS 2013

Basic Information

MA4408 is a semester module in English language at Master’s level which is offered in summer semester.

This Module is included in the following catalogues within the study programs in physics.

Specialization Modules in Elite-Master Program Theoretical and Mathematical Physics (TMP)

Total workload	Contact hours	Credits (ECTS)
270 h	90 h	9 CP

Content, Learning Outcome and Preconditions

Content

Markov chains in continuous time, Markov property,
convergence to equilibrium. Feller processes, transition semigroups and their generators, long-time behaviour of the process, ergodic theorems. Applications e.g. to queuing
theory, interacting particle systems or time series.

Learning Outcome

After successful completion of the module, students are able to:
- understand and apply the Markov property
- do calculations with Q-matrices and invariant/reversible distributions
- understand the basics of the theory of Feller processes
- apply ergodic theorems
- analyse the long-term behaviour of a given Markov process.

Preconditions

MA2409 Probability Theory

Courses, Learning and Teaching Methods and Literature

Courses and Schedule

SS 2022 SS 2021 SS 2020 SS 2019 SS 2018 SS 2017 SS 2016 SS 2015 SS 2014

Type	SWS	Title	Lecturer(s)	Dates	Links
VO	4	Markov Processes [MA4408]	de Paula Reis, G. Gantert, N.	Mon, 12:15–13:45, BC2 BC2 3.5.06 Wed, 08:30–10:00, BC2 BC2 3.5.06
UE	2	Markov Processes (Exercise Session) [MA4408]	de Paula Reis, G. Gantert, N.	Mon, 10:15–11:45, BC2 BC2 3.5.06

Learning and Teaching Methods

lecture, exercise module
The module is offered as lectures with accompanying practice sessions. In the lectures, the contents will be presented in a talk with demonstrative examples, as well as through discussion with the students. The lectures should motivate the students to carry out their own analysis of the themes presented and to independently study the relevant literature. Corresponding to each lecture, practice sessions will be offered, in which exercise sheets and solutions will be available. In this way, students can deepen their understanding of the methods and concepts taught in the lectures and independently check their progress.

Media

blackboard, assignments

Literature

T. Liggett (2010): Continuous time Markov processes, American Mathematical Society, USA.

Module Exam

Description of exams and course work

The module examination is based on a written exam (90 minutes) or an oral exam (20-30 minutes), depending on the number of attendants. Students have to understand foundations of the Markov property and can adequately apply them in limited time. They are familiar with Feller processes and are able to use ergodic theorems.

Exam Repetition

The exam may be repeated at the end of the semester.

Current exam dates

Currently TUMonline lists the following exam dates. In addition to the general information above please refer to the current information given during the course.

Title
Time	Location	Info	Registration
Markov Processes
	1050
	00.06.011