Purpose
Mixed Reality (XR) is an emerging method in diagnostic imaging data presentation with a HoloLens (Microsoft, Redmond, U.S.) system beeing one of the most advanced examples of the XR technology commercially available.
XR technology is capable of presenting any anatomic region and pathologic changes as holograms thanks to advanced 3D image creation by mean of head mounted displays (Fig.1).
Holograms produced from medical imaging DICOM data may require initial complex preparation (segmentation) of the data to be further presented in XR during a medical procedure...
Methods and materials
Standard DICOM network protocols and settings were used to connect a Windows 10 PC computer running a CarnaLife Holo software (MedApp, Cracow, Poland; Fig.3) to a variety of imaging modalities directly (CT, MRI, 3DRA) or indirectly (via PACS).
DICOM OFFIS Toolkit (OFFIS e.V., Germany) "storescp" service was used to manage incoming images storage on a PC.
CarnaLife Holo software was automatically activated and instantly loaded the DICOM datasets right upon 3D image series arrival.
The ad-hoc created 3D volume rendered data were instantlystreamed to the...
Results
Directly after data transfer the user was able to instanly interact with the holographic volume rendered 3D data in Mixed Reality environment.
Advanced rendering options were tested to improve data visualization. Data manipulation (rotation, translation, scaling) using voice commands and gestures allowed accurate navigation through the datasets from various imaging modalities.Fig.5-9.
Conclusion
In this feasibility study we confirmed usefulness of CarnaLife Holo software as an "automatic medical hologram generator" that can be used with variety of imaging modalities.
The approach can instantly "turn patients info holograms" eg. during medical procedures relying on 3D image data aquisitions like 3DRA or interventional CT.
Variety of clinical scenarios should be researched to explore the clinical value of this approach in everyday practice.
ADDITIONAL NOTE:
The interaction with DICOM data using CarnaLife Holo software and the HoloLens system can be experienced...
Personal information and conflict of interest
L. Kownacki; Warsaw/PL - nothing to disclose M. J. Stanuch; Cracow/PL - Employee at MedApp D. Piotrowska-Kownacka; Warsaw/PL - nothing to disclose A. A. Zlahoda-Huzior; Cracow/PL - Employee at MedApp M. Kierepka; Cracow/PL - CEO at MedApp K. Błachnio; Otwock/PL - nothing to disclose K. Janc; Cracow/PL - Employee at MedApp M. Kurzyna; Otwock/PL - nothing to disclose S. Darocha; Otwock/PL - nothing to disclose
References
1)
Augmented reality and three-dimensional printing in percutaneous interventions on pulmonary arteries
Authors: Jan Witowski, Szymon Darocha, Łukasz Kownacki, Arkadiusz Pietrasik, Radosław Pietura, Marta Banaszkiewicz, Jakub Kamiński, Andrzej Biederman, Adam Torbicki, Marcin Kurzyna
Vol 9, No 1 (January 2019): Quantitative Imaging in Medicine and Surgery
2)
http://www.offis.de/
