Simulation & Education Projects

Augmented Reality for Medical Diagnosis and Surgery Planning

During medical procedures, there is a risk of doctors missing important abnormalities or tissues specific to a patient, such as blood clots or inflammation. These errors may be attributed to lack of an effective approach to observe imaging data specific to the patient's body during the procedure. Using machine learning and computer vision algorithms, we can enable identification of different human anatomies from medical images. Using an augmented reality visualization device such as the Microsoft Hololens, we can overlay an MRI scan on the body for a direct relational view. This can facilitate the accurate identification of structures and detect and highlight important organs or anatomical volumes within the body cavity, thus informing surgeons of the pseudoboundaries of important body structures during surgical procedures.

 

Virtual Reality for Education of Public Health Professionals

We're exploring new ways to teach important public health concepts using immersive technologies that can be deployed without a computer. This recent project in partnership with the Champaign-Urbana Public Health District created a unique virtual reality training module using interactive, 360-degree video to teach food safety concepts. CUPHD requires certification for temporary food service managers, such as those at fairs or concession stands, and there are many rules and regulation on how to keep food safe to eat. The module takes the learner through various concession stand scenarios and asks questions about correct procedures, temperatures, and laws regarding food safety.