de | en

Medical Augmented Reality

Module IN2293

This Module is offered by TUM Department of Informatics.

This module handbook serves to describe contents, learning outcome, methods and examination type as well as linking to current dates for courses and module examination in the respective sections.

Basic Information

IN2293 is a semester module in English language at Master’s level which is offered in winter semester.

This Module is included in the following catalogues within the study programs in physics.

  • Catalogue of non-physics elective courses
Total workloadContact hoursCredits (ECTS)
150 h 60 h 5 CP

Content, Learning Outcome and Preconditions

Content

Lecture:
+ Basics of intra-operative imaging and navigation.
+ Camera calibration using multi-view approaches.
+ Different tracking technologies including: RGB and infrared cameras, optical trackers, Kinect.
+ Projective geometry basics including transformations and reconstruction.
+ Review of multimodal registration, visualization and user interfaces.
+ Real-examples using head mounted display (HMDs), Camera augmented mobile C-arm (CamC) and, intraoperative gamma probes coupled with AR capabilities, AR magic mirror for anatomy education.
+ Includes visits to the Navigated Augmented Reality Visualization Systems Laboratory, Chirurgische Klinik und Poliklinik Innenstadt; and IFL: Interdisziplinäres Forschungslabor, Klinikum rechts der Isar.

Exercises (every two weeks):
+ Using MatLab or C++
+ Implementation of lecture course topics with students in groups of 2.

Learning Outcome

In-situ visualization in medical augmented reality (AR) enables the registered view of virtual data such as a 3D CT scan, with a video view of the real anatomy of a patient. Data can be aligned with the required accuracy such that surgeons do not have to analyze data on an external monitor in the operating room. Instead, surgeons get a direct view onto and into the patient. Mental registration of medical imagery with the operation site is not necessary anymore. Augmenting medical images and virtual surgical instruments within the body provides the most intuitive way to understand the patient’s anatomy within the region of interest. This allows for the development of completely new generations of surgical navigation systems. Our Chair for Computer Aided Medical Procedures (CAMP) is one of the strongest and leading research centers for medical AR world-wide, featuring the world’s most accurate video-see-through AR system based on a head-mounted-display. Also, CAMP has developed the world’s first AR-enabled C-arm, CamC, which has already been tested in clinical trials in Munich. The objectives of this lecture are to have students learn the theoretical basics and practical aspects of augmented reality solutions related to the medical field. The content of the lectures are outlined below.

Preconditions

none

Courses, Learning and Teaching Methods and Literature

Courses and Schedule

TypeSWSTitleLecturer(s)Dates
VI 5 Medical Augmented Reality (IN2293) Eck, U. Navab, N.
Assistants: Grimm, M.Martin Gomez, A.Winkler, A.
Thu, 16:00–17:30, MI 00.04.011
Tue, 12:00–13:30, MI 03.13.010

Learning and Teaching Methods

Lecture blocks followed by an exercise block the following week

Media

Slides

Literature

Terry Peters and Kevin Cleary - Image Guided Interventions - Technology and Application – Springer 2008 - ISBN-10: 0387738568

Workshop and Proceedings of the following congresses
- IPCAI/CARS
- MICCAI
- SMIT
- ISMAR

Module Exam

Description of exams and course work

Written exam

Exam Repetition

The exam may be repeated at the end of the semester.

Top of page