Advanced Deep Learning for Computer Vision
This module handbook serves to describe contents, learning outcome, methods and examination type as well as linking to current dates for courses and module examination in the respective sections.
IN2364 is a semester module in English language at Master’s level which is offered every semester.
This Module is included in the following catalogues within the study programs in physics.
- Catalogue of non-physics elective courses
|Total workload||Contact hours||Credits (ECTS)|
|240 h||75 h||8 CP|
Content, Learning Outcome and Preconditions
- Advanced Auto-encoders: Probabilistic approaches and the mathematical foundations (e.g., variational auto-encoders)
- Generative Adversarial Networks (from Goodfellow to CycleGANs and Progressive GANs)
- Autoregressive Networks and their parallelization
- Probabilistic vs deterministic generative methods
- Advanced RNNs and LSTMs (focus on math behind gradient propagation)
- Multi-dimensional CNNs: from audio to 3D scene environments; 3D vs multi-view CNNs, sparse CNNs (e.g., Octrees); spatio-temporal neural networks.
- CNNs on meshes: learning on structured and unstructured graphs. Mesh data structures and derived convolution operators on meshes using differential geometry.
- Reinforcement, Representation, and Deep Q Learning for Vision Problems; Deep Learning for Game AI (from Atari Games to Chess and Go, and ultimately Video Games)
- Bayesian DL (strong focus)
- Advanced Optimization and Hyperparameter tuning strategies
- Open Problems in Deep Learning for Computer Vision
MA0901 Linear Algebra for Informatics
IN2346 Introduction to Deep Learning (expert knowledge required!)
This is the advanced lecture for deep learning with a specific focus on computer vision. Taking the “Introduction to Deep Learning” course is expected.
Courses, Learning and Teaching Methods and Literature
Courses and Schedule
|VO||2||Advanced Deep Learning for Computer Vision (IN2364)||Leal-Taixe, L. Nießner, M. Weitz, S.||
|PR||3||Practical session: Advanced Deep Learning for Computer Vision (IN2364)||Leal-Taixe, L. Nießner, M. Weitz, S.|
Learning and Teaching Methods
The practical sessions will be key, students shall get familiar with Deep Learning through hours of training and testing. They will work with PyTorch and implement advanced network architectures.
Description of exams and course work
- After each practical session, the students will have to provide the written working code to the teaching assistant for evaluation.
- In the written exam (40% of the final grade), we will ask questions regarding lecture theory
- In addition, to the written exam, the results of the projects will be evaluated (60% of the final grade); we will evaluate projects on a (bi-) weekly basis including reports (33.33%), oral presentations (33.33%), and code/submissions (33.33%).
There is a possibility to take the exam in the following semester.