Applications of Extended Reality Technologies for Simulation, Education, and Clinical Care Delivery at Michigan Medicine (video)

The medical campus recently developed a center initiative for medical and surgical extended reality(CMSXR). This initiative now involves over 60 faculty, residents, and students from 12 clinical departments. In collaboration with the Center for Academic Innovation(CAI) and industry partnerships with Microsoft, GigXR, ApoQlar, AxonPark VR, and Iristick, and others, CMSXR has developed several ongoing XR programs for teaching and simulation, clinical-skills development, trainee autonomy assessment, and clinical-care delivery. These include using mixed reality headsets to improve clinical tele-rounding, telesurgery, and teleconsulting. Integrating novel imaging software to generate 3D holographic models that can be manipulated by remote users for operative planning and decision-making as well as incorporating virtual training tools to improve clinical skills acquisition and competency-based assessments for students and residents. These tools allow for sharing expertise and clinical collaboration with international partners to assess complex cases with experts from around the world in real time at the bedside, and have potential to revolutionize medical education, simulation, and clinical care and access to expert specialists. We have also completed 3 International Mixed-Reality Grand Rounds events with Imperial College of London, as well as several national webinars highlighting these XR technologies. Other efforts include a new massive online open course(MOOC) for Coursera and a NSF IUCRC Center opportunity in partnership with University of Maryland to advance the field of Mixed Reality in Medicine. A bigger industry-academic partnership with Microsoft is creating a global center of excellence for medical innovation using XR technologies and is launching several pilot programs across the medical campus.