Placing and Docking Medical Devices Using Mixed Reality

Abstract

Minimally invasive surgery and medical operations in hospitals and medical centers have seen advancements due to the increased capabilities and precision offered by medical devices in their provided services. Nonetheless, doctors and healthcare staff encounter notable challenges when it comes to operating, configuring, and docking these devices, particularly in newly established medical facilities of varying sizes and specialized requirements, considering the dimensions and weight of certain devices. This study seeks to present an efficient solution for the handling and placing of medical devices such as (Da Vinci Robot, MRI, C-ARM) within hospital environments. The primary objective is to project the 3D model of the medical device into the desired space using Microsoft HoloLens 2, providing the medical team with a preview of spatial awareness. Where the 3D model gave a solution for simulating the real medical devices moving and docking in the real environment. This approach aids in preventing interference with obstacles and allows for strategic planning of the optimal path for handling and docking the actual medical device. For example, the 3D model of the Da Vinci surgical robot was accurately positioned on the floor, considering nearby obstructions, and replicated the precise dimensions of the authentic system (height: 175.3 cm, length: 127 cm, width: 91.5 cm). In this preliminary investigation, we assessed the system's effectiveness in reproducing real barriers that restrict the movements of the medical device and its usability in managing the virtual replica of the device.