Computational Medical XR at SIGGRAPH Asia 2024

On December 5, 2024, Pr Papagiannakis and Dr Kannape gave the first ever course on Computational Medical XR at the SIGGRAPH Asia event in Tokyo, Japan.

Course Description

In the rapidly evolving landscape of digital medicine and healthcare, Computational Medical Extended Reality (CMXR) emerges as a groundbreaking discipline that synergizes life sciences, neuroscience, and computational science. This course aims to equip computer graphics scientists and engineers with the knowledge and skills to leverage CMXR technologies in developing advanced medical applications.

Over the span of this course, participants will embark on an exploration of the theoretical underpinnings and practical implementations of CMXR. The course begins with an introduction to CMXR, delineating its scope and distinguishing it from traditional Clinical and Medical XR. By integrating neural simulation, computational geometry, computer graphics, and deep learning models, CMXR addresses critical challenges in medicine and neuroscience.

The state-of-the-art section will provide insights into recent advancements and research in VR/AR/MR technologies particularly focusing on medical training and assessment. Participants will learn about successful clinical trials and case studies that demonstrate the efficacy of CMXR in transforming medical education. This segment will also highlight the role of edge computing, neuroscience, and spatial computing in advancing the field.

The hands-on sessions will enable participants to apply their theoretical knowledge practically. Using the MAGES-SUITE platform, they will create two medical XR applications: a training module and an assessment tool. The training application session will focus on the step-by-step development of a VR surgical training module, utilizing low-code/no-code tools for rapid prototyping. The assessment tool session will guide participants in designing a module for evaluating therapeutic skills, incorporating real-time analytics and feedback mechanisms.

The course will conclude with a discussion on the challenges and future directions in CMXR, encouraging participants to engage in an interactive dialogue. By the end of this course, attendees will have a comprehensive understanding of CMXR and its transformative potential in medical training, positioning them at the forefront of innovation in this dynamic field.

• Lecture Notes are publicly available https://asia.siggraph.org/2024/presentation/?id=crs_117&sess=sess219