  3D data from high-resolution volumetric imaging is a central resource for
diagnosis and treatment in modern medicine. While the fast development of AI
enhances imaging and analysis, commonly used visualization methods lag far
behind. Recent research used extended reality (XR) for perceiving 3D images
with visual depth perception and touch but used restrictive haptic devices.
While unrestricted touch benefits volumetric data examination, implementing
natural haptic interaction with XR is challenging. The research question is
whether a multisensory XR application with intuitive haptic interaction adds
value and should be pursued. In a study, 24 experts for biomedical images in
research and medicine explored 3D medical shapes with 3 applications: a
multisensory virtual reality (VR) prototype using haptic gloves, a simple VR
prototype using controllers, and a standard PC application. Results of
standardized questionnaires showed no significant differences between all
application types regarding usability and no significant difference between
both VR applications regarding presence. Participants agreed to statements that
VR visualizations provide better depth information, using the hands instead of
controllers simplifies data exploration, the multisensory VR prototype allows
intuitive data exploration, and it is beneficial over traditional data
examination methods. While most participants mentioned manual interaction as
best aspect, they also found it the most improvable. We conclude that a
multisensory XR application with improved manual interaction adds value for
volumetric biomedical data examination. We will proceed with our open-source
research project ISH3DE (Intuitive Stereoptic Haptic 3D Data Exploration) to
serve medical education, therapeutic decisions, surgery preparations, or
research data analysis.
