Abstract
The integration of Virtual Reality with radiology is the focus of this study. A narrative review has been proposed to delve into emerging themes within the integration of Virtual Reality in radiology by scrutinizing reviews gathered from PubMed and Scopus. The proposed approach was based on a standard narrative checklist and a qualification process. The selection process identified 20 review studies. Integration of Virtual Reality (VR) in radiology offers potential transformative opportunities also integrated with other emerging technologies. In medical education, VR and AR, using 3D images from radiology, can enhance learning, emphasizing the need for standardized integration. In radiology, VR combined with Artificial Intelligence (AI) and Augmented Reality (AR) shows promising prospectives to give a complimentary contribution to diagnosis, treatment planning, and education. Challenges in clinical integration and User Interface design must be addressed. Innovations in medical education, like 3D modeling and AI, has the potential to enable personalized learning, but face standardization challenges. While robotics play a minor role, advancements and potential perspectives are observed in neurosurgery and endovascular systems. Ongoing research and standardization efforts are crucial for maximizing the potential of these integrative technologies in healthcare. In conclusion, the synthesis of these findings underscores the opportunities for advancements in digital radiology and healthcare through the integration of VR. However, challenges exist, and continuous research, coupled with technological refinements, is imperative to unlock the full potential of these integrative approaches in the dynamic and evolving field of medical imaging.
1. Introduction
1.1. Virtual Reality’s Transformative Role in Healthcare: An Introduction
Virtual Reality (VR) has seamlessly integrated into the healthcare landscape for several years, exerting a dynamic influence across a myriad of sectors []. Its impact spans from the potential to improve surgical procedures and enhance radiological practices to playing a pivotal role in both motor and psychological rehabilitation, extending its reach even into specialized fields like dentistry []. This transformative contribution is not only confined to day-to-day clinical operations, but is also profoundly reshaping the landscape of medical training []. In the current landscape, the fusion of VR with robotics across diverse application domains, coupled with the incorporation of Augmented Reality (AR) [,], signifies a compelling evolution in healthcare technologies.
The heightened interest and recognition of the potential of VR and AR have led the Food and Drug Administration (FDA) to categorize them as integral medical devices [,]. For example, AR devices are already in use, projecting diagnostic and anatomical images directly onto a patient’s surface within the operating room. The FDA maintains an updated catalogue of cutting-edge AR and VR devices on its website [,], showcasing their applications across a spectrum from physiotherapy to simulated learning, and from providing support during surgical procedures to facilitating the analysis of intricate radiological images.
Within this landscape, certain devices have the capability to record intricate eye movements, concurrently delivering auditory and visual stimuli. This not only aids medical professionals in the diagnosis of neurological or vestibular disorders, but also represents a groundbreaking approach to medical assessment. Furthermore, there are devices specifically engineered to address visual impairments such as “lazy eye” or amblyopia, prevalent among children. These conditions, characterized by a reduction in visual acuity in one eye without overt pathological signs, are tackled through the strategic deployment of virtual reality headsets that project specially crafted videos, aiming to stimulate and encourage the usage of the “lazy eye” for more effective treatment []. This innovative intersection of virtual reality and healthcare showcases the potential to transform diagnostic and therapeutic approaches, marking a paradigm shift in the medical landscape.
1.2. Virtual Reality and Radiology: Exploring Related Studies to Formulate Hypotheses and Research Directions
1.2.1. Radiology Meets Digital Health: A Seamless Blend
Radiology has undergone a transformative evolution thanks to the digitization processes driven by the Digital Imaging and Communications in Medicine (DICOM) standard []. Over the years, the evolution of radiology has significantly eased its integration into the broader landscape of Digital Health. This transition marks a fundamental shift from the analogic to the digital field, where radiology increasingly finds itself intertwined with the vast array of possibilities offered by digitalization processes. This integration, driven by the swift standardization of DICOM in radiology—unlike in fields like digital pathology [], where DICOM adoption lagged (the specialized DICOM for digital pathology, DICOM Whole Slide Image [], has had a much longer release time and a more articulated adaptation of the manufacturers [,])—has been instrumental in expanding data exchange capabilities. Additionally, it has broadened the scope of applications, incorporating emerging technologies. Moreover, it has been pivotal in fostering the expansion of remote diagnostics, particularly evident in the field of teleradiology [,]. Furthermore, advancements in technology have led to the development of increasingly miniaturized voxels compared to the rudimentary CT applications of the 1970s, further propelling the integration of radiology into the digital landscape. All of this has facilitated the integration with other technologies, such as VR technologies [].
This integration, facilitated through DICOM, has been instrumental in fostering seamless communication and integration among various diagnostic imaging systems, thanks to the adoption of Picture Archiving and Communication Systems (PACS). This interoperability extends across diverse imaging modalities, encompassing not only systems reliant on ionizing radiation imaging processes, but also those leveraging alternative techniques such as nuclear magnetic resonance or ultrasound.
The integration, primarily spearheaded by radiology, is often referred to as “digital radiology”, particularly concerning the comprehensive storage of all images, including those not strictly of a radiological nature. For instance, Radiology Information Systems (RIS) play a crucial role in managing not just computed tomography (CT) and radiography images, but also those generated through magnetic resonance imaging (MRI) scans and others.
However, it is worth noting that the term “digital radiology” sometimes extends, albeit improperly, beyond radiological systems within hospital contexts. This expansion occurs because these systems rely on shared data storage and management processes (PACS, RIS) that have been inherited from the historical development of radiology. Consequently, even non-radiological imaging data becomes part of this integrated digital framework.
These integrated systems serve as the foundation for a comprehensive array of processing tasks, ranging from diagnostic analyses to the intricate planning of radiotherapeutic treatments. Such treatment planning heavily relies on the precise delineation of volumes and areas, which are meticulously identified through the imaging data provided by these systems.
1.2.2. Digital Radiology Meets Virtual Reality: Proposing Hypotheses and Research Avenues
Regarding the details of VR applications in radiology, various areas of interest have been delineated, with a history dating back to 1994 [], when the first applications of VR were more associated with the 3D rendering (an interpretation of the concept of VR that has endured over time, maintaining its relevance and validity despite technological advancements and changes in the digital application landscape). The significant impact of digital radiology in this field, as highlighted by a reasoning similar to the previous one, is reported in [], emphasizing how digital radiology, in its extended sense, providing 3D images, also plays a significant role in other disciplines for which it is an indispensable support (e.g., surgery, orthopedy, oncology treatment, and many others). This study [] not only reaffirms the pivotal role of radiology in this context, but also identifies the potential development directions, as outlined in Table 1.
Table 1.
Emerging topics based on the study by Javaid et al. [].
This drive for integration leads to an increasingly thorough exploration of emerging needs, spanning regulatory requirements, training, organizational aspects of work, and technological prerequisites [,].
1.2.3. Virtual Reality in Radiology: Technological Components, Integration towards Extended Reality, and the Contribution of COVID-19 to Research Expansion
Technological Components and Integration towards Extended Reality
The concept of VR is incredibly expansive and inclusive, encapsulating a spectrum of definitions that underscore its diverse applications. From rudimentary computer-generated 3D reconstructions to immersive navigational experiences powered by cutting-edge technology, VR encompasses a wide array of possibilities. According to Cambridge Dictionary, VR is defined as “a set of images and sounds, produced by a computer, that seem to represent a place or a situation that a person can take part in” (https://dictionary.cambridge.org/it/dizionario/inglese/virtual-reality) (accessed on 15 April 2024) []. This definition paints a picture of immersion where users feel deeply engaged in simulated environments, blurring the lines between reality and virtuality.
Building upon this notion, Collins Dictionary elaborates that VR constitutes “an environment which is produced by a computer and seems very like reality to the person experiencing it” (https://www.collinsdictionary.com/it/dizionario/inglese/virtual-reality) (accessed on 15 April 2024) []. This description emphasizes the striking realism of VR environments, suggesting that users perceive them with a heightened sense of presence, akin to their experiences in the physical world.
For a more technical perspective, Merriam-Webster characterizes VR as “an artificial environment experienced through sensory stimuli (such as sights and sounds) provided by a computer, where one’s actions partially determine what unfolds within the environment” (https://www.merriam-webster.com/dictionary/virtual%20reality) (accessed on 15 April 2024) []. This definition underscores the interactive nature of VR, highlighting how users’ movements and interactions shape their experiences within virtual realms.
Together, these definitions underscore the vast potential of VR technology, spanning from basic simulations to deeply immersive environments driven by sensory feedback. This breadth showcases the versatility of VR across various domains, including its transformative impact on fields such as radiology.
Based on Jvaid et al. [], VR has the potential to transform the radiology field by enhancing the capability to provide digital images for intervention guidance, medical training, and education. Radiologists can analyze complex medical conditions with greater precision through 3D imaging of diseased body parts or entire anatomical structures using VR. This transformative technology allows for the visualization of tissues, organs, vessels, and abnormalities in a 3D format, providing a deeper understanding of human anatomy [,,,], also transforming datasets into interactive virtual images that behave like holograms []. Through VR, it is possible to propose real-time holographic displays of 3D images, allowing radiologists to visualize internal body structures in three dimensions [,].
Therefore, various types of technologies can be identified, including Non-immersive Virtual Reality, Fully Immersive Virtual Reality, Semi-Immersive Virtual Reality, Augmented Reality, and Collaborative VR, offering extensive applications in radiology, catering to diverse clinical needs [,,].
Thanks to these technologies, based on the study reported in [], there is the potential to provide significant support to the world of radiology in its various integrations in the healthcare domain. For example:
- In surgical settings, VR has the potential to enhance surgical precision and collaboration among radiologists and specialists, benefiting procedures like ophthalmology, microsurgeries, and neurosurgery [,,].
- 3D computer-generated images accessible through wearable devices can be utilized in VR, transitioning from entertainment to essential tools in healthcare [,].
- Advanced training and diagnosis solutions can be provided, supporting active learner participation, and enabling real-time patient support [,].
- Advanced training programs for staff and VR tools can be integrated into patient care workflows, enhancing staff capability and confidence [,].
It should be noted that the integration of Virtual Reality into radiology, the true focus of this proposed study, is often accompanied by the integration of other forms of “artificial reality”, such as Augmented Reality, to the extent that Virtual and Augmented Reality (VAR) is often mentioned. Recently, as an extension of this concept, Extended Reality (ER), also referred to with the acronym XR, has been discussed.
For Augmented Reality, the spectrum of definitions is broad and can encompass various sectors based on the technologies utilized. The approach of augmented reality is different from that of Virtual Reality, as it aims to maintain a direct relationship with physical reality by adding informational content obtained from digital processing. The following definition remarks just this: “an enhanced version of reality created by the use of technology to overlay digital information on an image of something being viewed through a device (such as a smartphone camera)” (https://www.merriam-webster.com/dictionary/augmented%20reality) (accessed on 15 April 2024) [].
XR, then, is a further new frontier that has been defined as an umbrella term encompassing VR, AR, and Mixed Reality (MR) [] (Figure 1). As highlighted in [], these technologies differ regarding the user’s ability to interact with the simulated environment and the degree of reality enhancement. Augmented reality (1) involves adding digital information to the real world, which the user can still see and interact with. In medicine, AR can be used for guidance during procedures by superimposing both virtual and real images into the environment in real-time [,]. Smartphone games, for example, commonly use this technology, such as in “Pokemon Go” (Niantic, Inc., San Francisco, CA, USA) or “The Witcher: Monster Slayer” (Spokko Inc., Warsaw, PL, USA). MR (2) combines digital and natural elements to create a new environment with which the user can interact in real-time []. Virtual Reality (3), the most well-known form of ER, creates an entirely immersive digital environment that replaces the real world []. It can also be used to provide a platform for remote training activities and scientific gatherings.
Figure 1.
Enhanced graphical depiction illustrating the interaction between VR/AR/MR/XR environments and the virtual as well as the real environment.
For the ultimate VR and MR interaction experience, a head-mounted device (https://www.sciencedirect.com/topics/engineering/head-mounted-device) (HMD) (accessed on 15 April 2024) [] or a cave automatic virtual environment (https://www.techtarget.com/whatis/definition/CAVE-Cave-Automatic-Virtual-Environment) (CAVE) (accessed on 15 April 2024) [] is essential. These technologies enable complete immersion in the virtual environment by blocking out the real world and displaying visualizations [,]. This distinction is frequently observed in ER studies published after 2020 [,,].
The Contribution of COVID-19 to Research Expansion
The year 2020 is an important year for this technology:
- Technological advancements led to the production of new ER tools since 2020 [,,].
- FDA approval initiatives for VR (and AR) tools as Medical Devices, started in 2015, have gradually accelerated from 2020 (until 2022) [] (see also: Table 2, based on an Excel dump from the public register; and the graphical presentation in Figure 2 and Figure 3) with 63% of approval in the years 2020–2022.
Table 2. Dump from the FDA public excel related to the online register of the approved VR/AR medical device.
Figure 2. Categorization of the VR/AR medical devices approved by the FDA as extracted from the Excel available online.
Figure 3. Distribution by year of FDA approbation of the VR/AR medical devices as extracted from the Excel available online. - The COVID-19 Pandemic’s momentum since 2020 has acted as a catalyst for numerous innovative technologies in the medical field.
Specifically regarding VR, whether alone, integrated with AR, or as part of ER, there has been a notable increase in publications in this realm since 2020 []. These trends are echoed in a plethora of research [,,,,,,,,,]. For instance, Mehraeen et al. [] (2023) conducted a systematic review on telemedicine technologies and applications during the COVID-19 pandemic, also highlighting the role of VR in radiology teleconsulting, while Hayre and Kilgour [] (2021) examined the current and future use of Virtual Reality in diagnostic radiography education amidst the pandemic. Similarly, Oulefki et al. [] (2022) proposed Virtual Reality visualization for computerized COVID-19 lesion segmentation and interpretation, whereas Yeung et al. [] (2022) delved into the current technology and future applications of Virtual Reality applications. Additionally, Liu et al. [] (2024) and Amara et al. [] (2022) investigated the augmented reality visualization and quantification of COVID-19 infections in the lungs, and also the use of augmented reality to aid COVID-19 diagnosis based on CT-scan segmentation using deep learning, respectively. Benbelkacem et al. [] applied VR for CT Image-Based Classification and Visualization.
These studies underscore the growing recognition and adoption of immersive technologies like virtual and augmented reality in radiology, a trend reinforced by Bhugaonkar et al. [] (2022) and Tsai et al. [] (2023), who explored the role of these components integrated into the health domain. Furthermore, Ong et al. [] (2021) delved into the potential of ER for enhancing telehealth both during and beyond the COVID-19 pandemic.
Standardization of VR in the Health Domain with a Focus on Radiology
As Ford once said, “True progress is only made when the benefits of a new technology become accessible to all”. Regarding VR, tangible progress can be measured if it is truly integrated into the health domain and its applications and opportunities are assessed. The integration of a device into the health domain must necessarily undergo certification to comply with regulatory processes before being introduced to the market and utilized within the healthcare system. VR systems intended for medical use are considered medical devices and must adhere to relevant certification processes, which vary based on their intended use and risk class. Regulatory bodies, such as the FDA for the US market, the EU Commission for the European market, and Health Canada for the Canadian market (among others), provide their respective roadmaps.
The FDA has addressed this integration issue and launched a dedicated website, last modified in September 2023 [], which not only lists a registry of FDA-approved medical devices with AR/VR (38 in total) in the US, but also offers an interactive system for scientific and communicative dissemination, monitoring, and roadmaps specific to these medical devices. The communicative dissemination is tailored with a dual focus and specific language, considering the involved stakeholders, and includes important infographics on VR/AR targeted specifically for patients [] and professionals [].
Further exploration in this area [] highlights that among the 38 approved medical devices, 14 are dedicated to radiology, while 15 are for orthopedics (see also Table 2 and Figure 2 and Figure 3). Four are for physical medicine, two are for neurology and ophthalmology, one is for cardiovascular, and one is for otolaryngology, while there is not a specific categorization for robotics. However, radiology not only falls among the 14 devices, but also contributes to orthopedics and other sectors as an imaging provider. Therefore, radiology plays a crucial role in this domain.
Regarding radiological devices based on VR, AR, or extended reality, these, along with the introduction of other technologies, have also impacted PACS as medical devices [,]. However, it has been clarified that, as of the date of the latest dissemination updates, presently, the use of VR/AR medical devices in this domain, FDA approvals are primarily limited to research and informational purposes, such as aiding patients in understanding informed consent procedures [,]. Initiatives with a particular focus on patients in provision of the diffusion of these technologies have also been undertaken by the FDA [].
Shifting the focus to Europe, it is evident that the current legislation is governed by Regulation (EU) 2017/745 of the European Parliament and the Council dated 5 April 2017 []. According to this regulation, VR is considered software as a medical device []. Based on a recent study reported in []:
- The transition towards this European directive from the previous one [] will conclude by May 2024 with adoption across all member states.
- A delay in adopting technological innovations such as VR is highlighted, along with an invitation for more concrete actions. According to the authors, it must be clearly understood how a VR software for medical application [,] differs from a general exergame [], considering the various medical areas in which VR [] can be applied.
A innovative stance compared to the FDA and the EU Commission, which appears to be lagging behind, is represented by Health Canada, which recently approved a class II medical device [] with VR for clinical diagnosis (previously limited to class I risk in other countries and never for direct diagnosis).
This innovative stance taken by Health Canada marks a significant shift in the regulatory landscape with potentially far-reaching implications. This recent approval of a class II medical device incorporating VR for clinical diagnosis represents a notable departure from previous regulatory frameworks. Traditionally, medical devices utilizing VR technology have been categorized as class I devices, indicating lower risk and not direct diagnostic capabilities. However, Health Canada’s decision to approve a class II device for clinical diagnosis signals a recognition of the evolving role and potential of VR technology in healthcare. This decision not only reflects Health Canada’s willingness to embrace innovative technologies, but also underscores a growing acceptance of VR as a viable tool for clinical diagnosis and patient care. By granting approval for a class II device, Health Canada acknowledges the increasing sophistication and reliability of VR-based diagnostic tools, paving the way for their wider adoption and integration into medical practice.
Moreover, this move may prompt other regulatory agencies, including the FDA and the EU Commission, to reassess their classification criteria for VR medical devices. As VR technology continues to advance and demonstrate its efficacy in healthcare settings, there is a growing need for regulatory frameworks that accurately reflect its capabilities and potential risks. Health Canada’s decision could catalyze discussions and initiatives aimed at updating existing regulations to better accommodate the evolving landscape of medical technology. Furthermore, the approval of a class II VR medical device for clinical diagnosis opens up new possibilities for healthcare providers and patients alike. Overall, Health Canada’s forward-thinking approach to regulating VR medical devices signals a promising future for the integration of Virtual Reality technology in healthcare.
1.3. The Rationale for a Narrative Review Study in This Field
Reviews are valuable for examining emerging and established themes in an emerging filed. Simultaneously, this analysis can also reveal less-explored and less-appealing topics. An overview of reviews, which analyzes a set of systematic reviews, provides a comprehensive view of these themes. Two possible approaches are to use a methodology for systematic reviews [] or to rely on a narrative review methodology []. Narrative review is preferable when exploring a topic flexibly, obtaining a general overview without following a rigorous systematic methodology. It is suitable when aiming to develop conceptual or theoretical frameworks, prioritizing methodological flexibility over an objective synthesis of specific evidence, and when seeking a comprehensive overview. In terms of emerging topics and a low number of published studies, a systematic review might not be the most suitable choice due to its restrictive study selection, as we have verified through preliminary simulations before proceeding. And for this reason, we have chosen to undertake a narrative review examination of reviews. This strategic approach is aimed at delving deeply into the multifaceted themes within this domain, utilizing a flexible and less rigid analytical tool. This method allows us not only to gain a broad overview, but also to capture the intricate nuances associated with emerging themes, thereby enhancing our understanding of the subject matter. The concept of VR within the field of radiology has undergone significant evolution, intertwining with advancements in technology while unlocking new potentials and diverse applications; ancient conceptions and new interpretations have succeeded each other, coexisting harmoniously. The emerging questions motivating the overview are the following:
- What do scholars mean by Virtual Reality in radiology applications, and how do they perceive it?
- How has the integration of Virtual Reality in radiology evolved over time, and what significant advancements and challenges have shaped this intersection, and what are the emerging themes/patterns?
- How has virtual reality been integrated in the radiology domain with other innovative technologies (e.g., robotics, Artificial Intelligence, and Augmented Reality)?
- In what ways has Virtual Reality demonstrated its potential to enhance diagnostic capabilities, improve medical training, or transform patient care within the field of radiology, and what are the current obstacles to overcome?
1.4. Purpose of the Study
This study conducts a comprehensive narrative review that explores and synthesizes the existing literature on the intersection between virtual reality and radiology. This review aims to elucidate the evolution of this integration, critically analyze the advancements and challenges encountered, and provide a nuanced understanding of how virtual reality is influencing diagnostic practices, medical training, and patient care within the radiological domain. The overarching purpose is to offer valuable insights for clinicians, researchers, and healthcare stakeholders, fostering a deeper appreciation of the current state, potential applications, and future directions in this rapidly evolving field.
2. Materials and Methods
This narrative review used the ANDJ standardized checklist (reported in the Supplementary Material as Table S1) designed for narrative reviews []. Such a narrative checklist is a methodological tool that provides detailed and structured guidance during the review process. It aids in standardizing the review process by establishing key criteria for use during the analysis, making the process of constructing the study transparent.
The PubMed and Scopus databases were inserted in the overview. A qualification methodology was used to choose the studies, based on the assessment of qualified parameters []. Based on the cited study [], we evaluated each contribution based on six key parameters:
- Clarity of study rationale in the Introduction.
- Appropriateness of work’s design.
- Clarity in describing methods.
- Clear presentation of results.
- Justification and alignment of conclusions with results.
- Adequate disclosure of conflicts of interest by authors.
The scoring system involves assigning graded scores (1 = min; 5 = max) to each one of the first five parameters based on the quality of each criterion.
For the last parameter, a binary assessment (Yes/No) is made regarding the disclosure of conflicts.
To preselect studies:
- -
- Each of the first five parameters must obtain a minimum score of 3.
- -
- The last parameter must be marked as “Yes” for conflict disclosure.
Only peer-reviewed studies were included, including studies published at a congress that were accepted and published following a peer-review process.
The defined search query for the core of this study (narrative review of reviews) was the following: =
(“(virtual reality[Title/Abstract]) AND (radiology[Title/Abstract])”)
The procedure-based overview identified 20 studies review studies (among them being 3 systematic reviews), matching the 95.2% of the PubMed query [].
These studies are as follows [,,,,,,,,,,,,,,,,,,,].
In the review work, in formulating introductory hypotheses, in supplementing the discussion, and as additional checks for controlling the core overview, we used also other keywords in different logic combination such as: “image”, “imaging”, “VR”, “radiography”, “image diagnostics”, “VR”; other MESH terms, such as “Radiology”, “Interventional Diagnostic Imaging”, “Image Interpretation”, “Computer-Assisted Radiographic Image Interpretation”, “Computer-Assisted Tomography”, “X-ray Computed Magnetic Resonance Imaging”, “Ultrasonography Three-Dimensional Imaging”, “Computer Simulation”, and “User-Computer Interface”; and other correlated terms such as “Virtual reality simulation”, “3D visualization”, “Augmented reality radiology”, “Virtual reality training”, “Virtual reality applications in radiology”, “Immersive technology in radiology”, “Virtual reality software”, “Medical virtual reality”, and “Virtual reality in medical education”.
Furthermore, targeted searches were also conducted on the official websites of certain international regulatory bodies in the healthcare field. This approach aimed to gather specific and authoritative information related to healthcare regulations from reputable sources. By exploring the content provided by these institutions, this review sought to ensure accuracy and relevance in addressing regulatory aspects within the healthcare domain.
3. Results
Below is an analysis of the trends of the studies in this field reported in Section 3.1, and a detailed analysis of the key elements emerging from the overview of each study (Section 3.2).
3.1. The Trends in the Studies on Virtual Reality in the Field of Radiology
A search was conducted on the PubMed database with search criteria outlined in Box 1, and yielded a total of 108 studies on the application of Virtual Reality in Radiology since the 1990s.
Box 1. The proposed composite keys.
| (virtual reality[Title/Abstract]) AND (radiology[Title/Abstract]) |
| (Virtual Reality[Title/Abstract]) AND (Radiology[Title/Abstract]) AND (applications[Title/Abstract]) |
| (virtual reality[Title/Abstract]) AND (radiology[Title/Abstract]) AND (robotics) |
Figure 4 illustrates the increase in the number of articles indexed in PubMed on the use of VR in radiology since the late 1990s, based on the search parameters given in Box 1. Figure 5 delineates the distribution of article types, specifically highlighting the prevalence of reviews (n = 18) and systematic reviews (n = 3) concerning the application of VR in radiology.
Figure 4.
Studies focusing on Virtual Reality and Radiology.
Figure 5.
Article types focusing on Virtual Reality and Radiology.
Research on this topic has accelerated considerably in two important periods, as shown in Figure 6. The first major increase occurred in the last decade (from 2014 to the present), when 72.2% of all indexed articles on this topic were published in the PubMed database. This era was a defining moment that highlighted the growing interest and concerted efforts to improve knowledge and understanding of the application of VR in the field of radiology.
Figure 6.
Temporal trend of reviews and systematic reviews published on the PubMed database from the 1990s to date.
After this initial upswing, a phase of even greater acceleration began with the outbreak of the COVID-19 pandemic. From 2020, almost half of all articles were published on this topic (48.1%). This increase can be attributed, as discussed in the Introduction, to the combination of three factors: Firstly, since 2020, there have been significant technological advancements leading to the development of new ER tools. Secondly, the FDA approval initiatives for VR and AR tools as medical devices, which began in 2015, saw a notable acceleration from 2020 to 2022. Approximately 63% of approvals occurred during this period. Thirdly, the COVID-19 Pandemic, starting in 2020, spurred the adoption of various innovative technologies in the medical field. The pandemic has been a key turning point for the adoption of technology in radiology, and has accelerated the digital transformation in various radiological settings.
In summary, the increase in PubMed articles on VR in radiology reflects the convergence of technological advances, the recognition of VR’s potential to transform medical imaging and education, and the collaborative spirit of modern scientific research. Taken together, these elements underline the increasing importance of VR in improving radiological practice and patient care.
3.2. Key Findings: Common Emerging Message and Emerging Themes/Patterns
3.2.1. Common Emerging Message
The collective findings from the literature reviews suggest a potential profound transformation in the landscape of radiology, driven by advanced technologies such as VR, often integrated with AR, Artificial Intelligence (AI), and, in some cases, with 3D printing. These reviews consistently underscore the multifaceted directions of development of these technologies in the health domain, where digital radiology plays an undeniable role as a connector. One prevalent theme is the considerable potential of VR and AR in radiological education. The immersive nature of these technologies proves effective in enhancing learning experiences, particularly in radiology and anatomy education based on radiological images as sources []. The reviews stress their role in improving anatomy knowledge, providing realistic simulations and offering interactive environments for training purposes thanks to the digital radiology sources [,]. This educational transformation extends to dentistry, where VR integrated with digital radiology, as well as AI, AR, and 3D printing, are identified as interesting directions for supporting diagnosis, surgery, and patient care []. The synergy among VR and other technologies, such as AI, emerges as a key player in radiology, promising significant future improvements in diagnostic precision and treatment customization, and in minimally invasive treatments []. Despite the promises, the reviews, including von Ende et al. [], acknowledge the existing obstacles limiting the widespread clinical acceptance of these solutions, emphasizing the need to overcome these challenges for broader adoption in interventional radiology. Simulation-based medical education (SBME) using VR stands out as a pragmatic solution for training radiology professionals. Reviews by Dankelman et al. [] and Rooney et al. [] emphasize the effectiveness and realism offered by VR in providing cost-effective and realistic training environments. Challenges in traditional training methods are addressed by proposing thoughtful development approaches based on models like Rasmussen’s []. However, amidst the enthusiasm for technological advancements, the reviews consistently bring attention to challenges and the necessity for further research. The standardization of VR integrated with AR, usability concerns, and technical considerations are recurrent topics [,]. The need for specialized user interfaces designed for radiologists is highlighted to ensure better acceptance and meet professional requirements []. Each review [,,,,,,,,,,,,,,,,,,,] calls for caution and tempers enthusiasm, bringing us back to the real state of integration that currently allows for limited routine use. Gamba et al. [] and Zhao et al. [] extensively emphasize the call for additional research to comprehensively understand the benefits and address the barriers to adoption.
Overall, these literature reviews collectively paint a picture of a potential dynamic shift in the radiological landscape, driven by the integration of VR with other technologies. However, while celebrating the potential in this field for enhanced education, diagnosis, and patient care, the reviews advocate caution, emphasizing the importance of addressing challenges, standardizing practices, and conducting further research to fully realize the transformative potential of these technologies in the radiology domain [,,,,,,,,,,,,,,,,,,,]. Practically all studies also highlight the current limits with caution regarding ethical and legal aspects. In discussing the limitations and ethical considerations surrounding VR and AR in medical contexts, several key points emerge. An excellent synthesis of the collective message of caution can be found in []:
- Firstly, the phenomenon of “cyber sickness” is a notable concern. This refers to discomfort experienced by users, including symptoms like nausea and dizziness, which can occur when using VR and AR applications. The underlying cause is often attributed to a mismatch between the visual perception of motion and the input from the vestibular system. To mitigate this, developers are exploring various strategies such as synchronizing movement with the user’s head motion and improving tracking accuracy.
- Secondly, in the realm of the VR and AR, ensuring accurate localization of virtual reconstructions over real-world anatomy is essential during image-guided procedures. Challenges include overcoming respiratory motion and organ deformation while maintaining smooth and accurate image movement. Moreover, the AR device must seamlessly integrate with the operator’s senses and be lightweight and comfortable for prolonged use.
- Furthermore, while VR and AR have the potential to simulate reality, achieving high levels of realism requires substantial resources and expertise. Hence, prioritizing simpler simulations for tasks like training may offer more immediate value.
- Caution is warranted in the adoption of VR and AR technologies in radiology and generally in the health domain. Regulatory approvals aside, rigorous research is needed to ascertain their efficacy in improving medical workflows and patient outcomes. Additionally, ethical concerns arise regarding the potential for inaccurate simulations to impact training quality and patient care. Collaborative oversight involving medical professionals, developers, and regulatory bodies is essential to ensure responsible integration.
Overall, addressing the limitations and ethical considerations of VR and AR technology is paramount for their safe and effective implementation in medical practice. Through careful research, strategic development, and collaborative oversight, these technologies can fulfill their potential to enhance healthcare delivery while safeguarding patient well-being.
3.2.2. Emerging Themes/Patterns
When analyzed in more detail, we can identify certain areas of common interest that were identified when examining the included studies.
- Integration of VR and AR in radiologySeveral reviews (Sutherland et al. [], Elsayed et al. [], Gamba et al. []) highlight the growth of VR and AR in radiology, emphasizing their potential to transform, in future, the clinical practice, medical education, and radiological workflows.
- Integration of VR with AI and impact on Radiologyvon Ende et al. [], Gurgitano et al. [], and Patel et al. [] discuss the increasing role of AI in radiology, focusing on its applications in diagnostic radiology, interventional radiology, and its potential impact on patient care, education, and treatment planning.
- Educational Applications of VR integrated with AR in radiologyGelmini et al. [], Chytas et al. [], and McBain et al. [] explore the effectiveness of VR and AR in medical education, particularly in radiology and anatomy, based on digital radiology imaging. The positive reception and effectiveness of these technologies in enhancing learning and skills acquisition are highlighted.
- User Interface (UI) Evolution with VR in RadiologyIannessi et al. [] delve into the evolution of user interfaces in radiology, emphasizing the need for radiologist-specific UIs for better acceptance and usability. The study discusses alternatives such as touchscreens, kinetic sensors, and augmented/virtual reality for two- and three-dimensional imaging.
- SBME and Training with VR in radiologyReviews by Rooney et al. [], Dankelman et al. [], and Alvarez-Lopez et al. [] focus on the importance of SBME and training, especially in radiation oncology, interventional radiology, and surgery. The effectiveness of VR and other technologies in providing realistic and cost-effective training solutions is highlighted.
- Advances in Imaging Technology and VR in radiologyRavindran [], Dammann [], ter Haar Romeny et al. [], and Zhao et al. [] discuss technological advances of VR integration with the digital radiology. The reviews emphasize improvements in image quality, 3D visualization, and the application of novel technologies, such as the 3D printing [], both in diagnostic and interventional radiology.
- Application of VR integration into radiology in Advanced Technology integration in DentistrySinghal et al. [] specifically highlight the potential impact of VR, AR, and 3D printing in dentistry based on digital radiology imaging, covering aspects such as diagnosis, surgery, and patient care.
- Shift in radiology education and Personalized LearningGuimarães et al. [] discuss the evolving trends in medical education, emphasizing a shift towards integrating basic and clinical sciences using technologies like 3D modeling and digital imaging. The potential role of AI and VR in personalized learning processes is highlighted.
- Integration of VR into Extended Reality (ER) in Diagnostic radiology ImagingKukla et al. [] focus on the use of ER in diagnostic radiology imaging, emphasizing its positive impact on patient positioning, medical education, and reduction of anesthesia use.
- VR and Advancements in Difficult Airway ManagementRavindran [] outlines advancements in managing difficult airways, including both the role of the digital radiology and 3D printing, suggesting opportunities in this field.
These emerging themes/patterns collectively indicate the trend of the development towards. However, the reviews also strongly remarks the need for further research, standardization, and overcoming challenges for broader adoption of these technologies. Another key point and focus of the review, which centered on various aspects of the integration of radiology with VR, was to comprehend both the scholars’ perception of this integration and to analyze other technologies involved specifically (AI, AR, ER, robotics, 3D printing). Many variables come into play here, ranging from the perception of the concept of VR (which, according to initial hypotheses, we found to be quite extensive) and other technologies, to the emphasis on radiology. In the Supplementary Material (s.2), excerpts from each study are also provided for those scholars who are interested.
3.2.3. The Focus on the Role of the Radiology and on the Virtual Reality in the Overviewed Studies
As observed in the initial hypotheses, radiology, besides its dedicated practice in this field, holds a transversal role across various medical sectors (such as surgery, anatomy, orthopedics, pathology, etc.), given its responsibility for preparing 3D data through established standards and sharing channels (DICOM, PACS, RIS). The integration of RIS/PACS, as inferred from the analysis, is often regarded by scholars in an all-encompassing manner for medical diagnostics (including, also, MRI, echographies, and other devices not based on radiography processes). Therefore, we chose to accentuate these two fundamental viewpoints and structure a more detailed presentation of the data with a specific focus on these aspects as well. Table 3 delineates the key elements/points emerging from the overview of reviews and systematic reviews, with a particular emphasis on the two specific aspects of radiology and VR integration, including other integrations.
Table 3.
Key elements/points emerging on the overview of reviews and systematic reviews.
4. Discussion
The discussion is organized into five parts. The first part, editorially translated in Section 4.1, presents the interpretation of the results, highlights opportunities, and suggests directions for further investigation. The second part, editorially translated in Section 4.2, complements the analysis with insights into areas where studies have focused on less, particularly in robotics. Section 4.3 reports a synoptic diagram linked with the study. The fourth and fifth parts, in Section 4.4 and Section 4.5, respectively, consist of the takeaway message and the limitations of the study.
4.1. Interpretation of Results of the Narrative Review, Opportunities, Limitations, and Suggestions for a Broader Investigation
The historical trajectory of VR applications in radiology, dating back to 1994 [], is outlining various areas of interest with the focus of the VR integration in radiology. In light of these considerations, we embarked on a comprehensive overview of reviews within this particular domain. The trends of dissemination, as illustrated in the results (Figure 6), have notably unveiled a rapid acceleration in scientific production in this field, particularly during the recent period characterized by the COVID-19 pandemic. Reviews play a pivotal role in pinpointing the stabilization of research themes and, indirectly, shed light on the topics that resonate most with scholars.
Upon a closer examination of the trajectory of scientific production in reviews (Figure 7), a discernible pattern emerges, showcasing a distinct shift following an initial surge of interest in this field. Intriguingly, there was a notable dip in the production of scientific reviews from 2005 to 2016. Further delving into the matter using the composite key provided in Box 1, position 2, it becomes evident that the overall trend in scientific production—encompassing not only reviews, but all applications—experienced a comparable plateau (Figure 7). This plateau is likely attributed to the challenge faced by scholars and stakeholders in perceiving and documenting a stable integration of developments within the health domain.
Figure 7.
Comparative analysis of publication trends for virtual reality in radiology and their applications from the 1990s to date.
An exploration of this trend reveals a resurgence of interest from the year 2017 onwards. During this period, more affordable hardware and software have become increasingly widespread. Concurrently, regulatory initiatives within the medical device domain have been initiated. Notably, in Europe, Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on medical devices was enacted around this pivotal period, amending Directive 2001/83/EC, Regulation (EC) []. Innovative facets, such as recognizing software as a medical device, have played a crucial role in fostering the diffusion and rekindling of interest in this field starting from 2017, even if subsequent studies have brought to light a notable delay in the adaptation of member states to the directive, particularly regarding VR [] the process of adjusting this regulation to accommodate ER systems has proven to be quite challenging. Simultaneously, regulatory bodies like the FDA have taken progressive steps by compiling and publishing lists of these devices based on VR and AR, a resource accessible online [] (Table 2, Figure 2 and Figure 3). Even though scientific paper writing is very rarely heavily influenced by regulatory initiatives, it could be interesting to delve deeper with targeted studies to explore if there is a correlation between the highlighted growth of interest and standardization activities.
All of this provides indirect additional motivation and justification for our review study. Our review has identified broad overarching themes and patterns that only partially cover the areas highlighted in [] (discussed later in this paper).
Significant opportunities, along with limitations and areas requiring further investigation, have been identified from this overview.
4.1.1. Emerging Opportunities
The literature underscores a wealth of opportunities at the junction of VR and medical imaging in the field of radiology. VR simulations have proven remarkably effective in medical education, notably in radiology and anatomy teaching []. Their immersive nature enhances learning outcomes, emphasizing the need for standardized integration []. Moreover, VR holds significant promise in improving radiological diagnosis and treatment planning. By providing intuitive tools for three-dimensional visualization of complex anatomical structures and pathologies, VR applications aid radiologists in making more informed diagnostic decisions while reducing interpretation time []. In treatment planning, VR may offer support in preoperative assessment and intraoperative guidance []. Surgeons can simulate surgical procedures in virtual environments, exploring various approaches and anticipating challenges before surgery. During procedures, AR overlays real-time imaging data onto the surgeon’s field of view, enhancing anatomical guidance and accuracy, thereby minimizing intraoperative complications.
Collaborative diagnostic workflows are also facilitated by VR platforms, allowing radiologists to remotely collaborate in real-time, regardless of geographical barriers []. Shared virtual workspaces enable experts to review cases together, exchange insights, and formulate optimal treatment strategies, thereby leveraging collective expertise and improving diagnostic consensus.
In medical education [], VR provides immersive, simulation-based learning experiences. Students can practice surgical procedures, navigate complex anatomical structures, and engage in realistic clinical scenarios within a safe virtual environment. This hands-on approach fosters procedural skills, decision-making abilities, and teamwork dynamics, preparing learners for real-world clinical practice with confidence and competence.
The integration of VR into radiology workstations highlights the potential for interactive and dynamic environments, albeit with a call for more comprehensive research []. Tailored designs are necessary to meet radiologists’ unique requirements, reflecting the evolving landscape of VR technology in medical imaging.
In conclusion, the convergence of VR and radiology signifies a transformative paradigm in radiological diagnosis, treatment planning, and medical education. VR’s immersive capabilities offer unprecedented levels of precision, efficiency, and collaboration, revolutionizing the way healthcare professionals approach patient care and education.
These opportunities reflect a dynamic landscape, emphasizing the potential for transformative advancements in healthcare, medical education, and diagnostic practices. Table 4 outlines the emerging opportunities synthesized from the analysis, succinctly summarizing the key findings in alignment with the referenced studies reported in a column.
Table 4.
Opportunities suggested by the overviewed studies.
4.1.2. Emerging Limitations and Areas Needing Broader Investigation
The overview has also highlighted significant limitations. The quality limitations and technological constraints faced by VR and AR sometimes hinder their widespread adoption in clinical applications []. Constraints in integrating VR and AR in healthcare include hardware limitations, software development challenges, and concerns about data accuracy and privacy. High-quality VR experiences require powerful computing equipment and specialized headsets, while AR devices may have limitations in field of view and tracking accuracy. Developing medical-grade VR and AR applications involves collaboration among developers, healthcare professionals, and regulatory bodies to meet safety standards, which can be time-consuming. Ensuring the reliability and integrity of medical data in virtual environments is crucial for preventing misinterpretation, while safeguarding patient data from breaches is essential for maintaining trust and compliance. Despite these challenges, ongoing advancements in hardware technology, software development practices, and regulatory frameworks are gradually addressing the limitations of VR and AR in clinical applications. Collaborative efforts between industry stakeholders, research institutions, and healthcare organizations are driving innovation and paving the way for the wider adoption of VR and AR in improving patient care, medical training, and therapeutic interventions [].
The potential benefits of VR-simulated radiology stations remain largely unexplored, with research being in its infancy. More studies are needed to understand the applications and overcome barriers to adoption []. Usability challenges persist in UIs for radiologists, with mouse and keyboard dominance. Tailoring UIs to the specific needs of radiologists is essential for better acceptance and integration [].
VR training, while promising for the training of interventional radiologists, faces challenges related to costs and ethical considerations. Investigating cost-effectiveness and ethical implications is crucial for informed decision-making []. ER positive impact on diagnostic procedures is hindered by challenges in clinical integration. Further research is required to address the associated cost-effectiveness and integration challenges []. The shift to virtual interviews in residency programs introduces challenges in technology adaptation and effective assessment. Strategies need to be developed to overcome these challenges and ensure a smooth transition []. In the realm of difficult airway management, despite technological advances, challenges persist in widespread adoption. Attention needs to be directed towards guideline compliance and effective application in clinical settings []. The transition from traditional training to VR in surgery encounters hurdles such as ethical concerns and high costs. Future research and thoughtful development approaches are essential for effective integration [].
While SBME is recognized for its effectiveness, improved reporting standards and centralized resource utilization are needed for broader adoption in radiation oncology training programs []. The application of COTS devices in surgery remains exploratory, especially in sterile environments. Further exploration is essential to understand their potential in contributing to training and preparation [].
In discussions concerning the limitations and ethical considerations surrounding VR and AR in this field, several key points emerge, sometimes in a nuanced way, and in another one in a profound way, from the overviewed studies [,,,,,,,,,,,,,,,,,,,]. A comprehensive synthesis of the collective message of caution can be found in []. The integration of VR and AR in healthcare raises ethical and legal concerns, including “cyber sickness”, precise localization of virtual reconstructions, and device integration. Caution is advised, stressing the need for thorough research, collaborative oversight, and addressing ethical issues for responsible implementation [].
Table 5 outlines the emerging limitations synthesized from the analysis, succinctly summarizing key findings in alignment with the referenced studies reported in a column.
Table 5.
Limitations/areas of improvements suggested by the overviewed studies.
4.2. Assessing Initial Assumptions: A Reflective Perspective and Comparative Analysis
Interpreting the findings derived from the initial hypotheses and primary questions posed within the narrative review, a multitude of significant considerations come to light. Firstly, scholars continue to perceive VR through both traditional [,] and avant-garde lenses [,,], reflecting the dynamic nature of VR research. Secondly, digital radiology plays a pivotal role beyond traditional radiography, extending to various clinical activities [,,]. FDA analysis reveals a significant presence of approved VR and AR devices tailored for radiological applications [], underlining radiology’s role in shaping medical imaging technologies. Despite technological advancements, the integration of VR and AR into medical practices requires caution due to regulatory limitations [,,]. Only very recent progress includes Canadian Health’s approval of Class 2 VR/AR devices for diagnostics []. While VR/AR systems promise transformation in diagnostic methodologies, their clinical implementation remains limited [,]. Academic discourse emphasizes thorough investigations into regulatory and ethical complexities [], advocating for informed decision-making and collaborative oversight. Concerns such as “cyber sickness” prompt developers to focus on improving tracking and synchronized movement []. Caution is warranted in adopting VR/AR in healthcare, emphasizing regulatory approvals and rigorous research to address ethical and efficacy concerns.
A narrative review of reviews, which serves as a compendium of consolidated themes, supplemented by international standardization analyses—a true indicator of integration within the health domain, as proposed in our study—is crucial for assessing technology consolidation and identifying gaps and criticalities. Caution is emphasized when comparing the insights gleaned from our overview of reviews, which focuses more on consolidated themes, with the review of articles and/or primary studies conducted by Javaid et al. [], as originally hypothesized. In the review by Javaid et al. [], numerous themes were identified, as outlined in Table 1.
In our overview of reviews, the themes have been greatly reduced and become less specific, as expected. However, when reading together the review in [] regarding the themes/patterns and emerging insights from this review of reviews, numerous reflections of caution have jointly emerged. Nonetheless, it is imperative to maintain a vigilant watch over the specific areas delineated in Table 1 and on the themes/emerging from this review of reviews, with particular attention to overcoming the detected problems. Should there be a discernible accumulation of consistent and pertinent medical knowledge, the prospect of undertaking targeted revisions, potentially even through systematic methodologies, emerges as a captivating avenue for further exploration and refinement of the themes detected in Table 1. The dynamic landscape of evolving technology and accumulating insights underscores the importance of ongoing scholarly engagement to meaningfully contribute to the advancement of knowledge in this field.
4.3. Advancements in Robotic Integration and Further Considerations
4.3.1. Highlights and Deepening from the Overview of Reviews
From the analysis reported in the preceding discussion, it emerges that, regarding the second question, “3. How has virtual reality been integrated in the radiology domain with other inno-vative technologies (e.g., robotics, artificial intelligence, and augmented reality)?”, while integration with AI, VR, and AR has been extensively developed, the treatment of integration with robotics remains rather limited. In fact, only three studies [,,] have touched upon the integration of VR with robotics in radiology. The study by Singhal et al. [] and the study by Damman [] have addressed this theme, albeit in a somewhat subtle and prospective manner. The first study [] tackled it in Oral Medicine and Radiology, Oral Pathology, and Oral Surgery, highlighting that alongside integration with Artificial Intelligence and VR, AR robotics will also present significant potential. The second study [], in an overview of the state-of-the-art of medical imaging processing methods, discusses the practical implications for the radiologist’s daily work and future aspects, including robotics.
The study by Alvarez-Lopez et al. [] delved into the integration of VR with robotics in a much broader context, which warrants further elaboration. Their review highlights intriguing perspectives that emerge from exploring this intersection that we resume in brief. The integration of VR and robotics in radiology presents significant promise, particularly in optimizing surgical procedures and workflow efficiency. This aspect, extensively discussed in the review [], highlights the utilization of COTS devices for gesture recognition during surgeries, while maintaining stringent asepsis and antisepsis protocols.
The early investigations referenced in [] delved into the feasibility of employing off-the-shelf systems equipped with various types of cameras to enable touchless interaction with medical images, particularly in critical environments like operating rooms. Among these systems, the MK and LMC emerged as top choices due to their high acceptance rates for manipulating medical data in sterile environments. Despite their benefits such as contactless operation, affordability, and robust gesture recognition capabilities, they do have drawbacks like latency issues and restricted gesture recognition.
However, both the MK and LMC have played crucial roles in enhancing workflow monitoring and collision avoidance in robotic surgery settings, as highlighted in []. Additionally, the Myo armband, discussed in [], offers a wearable solution for gesture-based interaction, although its limited sampling frequency is a limitation. Nevertheless, it shows promise in improving natural user interaction and efficiency in surgical image manipulation.
The application of gesture-based off-the-shelf devices in robotic surgery faces challenges, including cost implications and technical limitations. Yet, recent studies suggest that devices like the LMC could provide cost-effective solutions for developing control interfaces in simulation environments for surgical robots, aiding in both training and actual procedures.
Furthermore, these devices have been utilized in surgical education, particularly in minimally invasive and robotic surgery, for skills learning, instrument tracking, and control interface development, offering immersive training experiences, as discussed in []. Ethnographic studies have provided valuable insights into gesture-based touchless interaction in surgical practices, considering social dynamics and collaborative workflows, although there is a need for objective validation studies, as highlighted in [].
Future research in this field, as emphasized in [], should focus on standardizing gesture-based interfaces, developing algorithms for gesture recognition and resolving issues related to temporal segmentation and spatial-temporal variability. Moreover, the development and validation of portable, low-cost virtual reality simulators for surgical training hold promise for enhancing accessibility and effectiveness in skills learning, as extensively discussed in []. Despite methodological limitations, exploring off-the-shelf devices in radiology and surgical practice remains an evolving area with substantial potential for improving patient care and surgical training, as discussed extensively in [].
While these devices may not possess the traditional characteristics of robots, such as mechanical limbs or autonomous movement, their role in enabling gesture-based control and interaction with robotic systems in surgical settings justifies their classification as robotic devices. They serve as crucial interfaces between surgeons and robotic components, facilitating precise control and manipulation during surgical procedures, thereby enhancing patient outcomes and surgical efficiency.
Moreover, for completeness, some details are reported in Supplementary Materials (s.3) regarding the COTS overviewed in the study.
4.3.2. A Complementary Review
Based on the above, we decided to complement the review by analyzing any other scientific productions (beyond the reviewed ones) using the composite key in Box 1, position 3. In addition to the studies mentioned in [,,], seven more studies have emerged [,,,,,,].
In two studies conducted before the year 2000, Benabid et al. [,] highlighted that neurosurgery served as a fundamental platform for the development of robot applications, primarily employing multimodal image guidance. Motorized tools were regularly utilized in stereotaxy and conventional neurosurgery, utilizing databases derived from multimodal numerical images. Moreover, they foresaw integration with AR and VR.
Shi et al. [] focuses on the application of endovascular robotic systems in robot-assisted interventional surgery, aiming to enhance surgical safety and minimize radiation exposure to surgeons. While such procedures demand a high level of skill in operating vascular interventional surgical robots, the development of a novel VR interventional training system emerges as a promising solution. This VR system, an extension of the endovascular robotic system, offers advantages over traditional training methods, improving training effectiveness and reducing educational costs. Notably, the study introduces an innovative method for catheterization modeling in interventional simulations, employing collision points to discretize the catheter and simulating its behavior as torsion-free elastic rods. This approach enhances stability, reduces computational complexity, and enables accurate simulation of catheter interaction and virtual force feedback in the proposed VR interventional training system. The effectiveness of this method is demonstrated through experimental validation.
Maresacux and Diana [] reported how the fields of surgery, interventional radiology, and advanced endoscopy have advanced minimally invasive techniques, significantly benefiting postoperative outcomes. However, the complexity of these techniques necessitates extensive training. The integration of robotics and computer sciences offers a solution to enhance and facilitate minimally invasive approaches. The manuscript envisions a convergence of surgery, advanced endoscopy, and interventional radiology into a new hybrid specialty—hybrid image-guided minimally invasive therapies. This collaborative approach aims to maximize positive effects and minimize the iatrogenic footprint on patients. Describing the fundamental steps of this paradigm shift, the manuscript anticipates this integration as the next innovative step in advancing minimally invasive surgical therapies.
Ni et al. [] emphasized the importance of ultrasound-guided biopsy as a fundamental but challenging skill in interventional radiology that requires intensive training for trainee radiologists, especially in needle insertion, to ensure safe procedures. This paper introduces a VR simulation system designed to enhance the training of radiologists and physicians in these procedures. Key features encompass 3D anatomical model reconstruction, data fusion of multiple ultrasound volumes and CT, realistic rendering, interactive navigation, and haptic feedback in six degrees of freedom. Users are presented with simulated ultrasound imagery, derived from actual ultrasound data, in real time, while conducting a needle placement examination into a virtual anatomical model. The system provides a lifelike haptic experience by means of a kind of robotic tool for trainees during simulated needle insertion, allowing for repeated practice without posing any risk to patients.
The study by Moix et al. [] discusses IR as a minimally invasive procedure using thin tubular instruments guided through the patient’s vascular system under X-ray imaging. The challenges in training radiologists for these procedures are outlined, noting drawbacks in existing simulation systems. The paper proposes a quality training environment for interventional radiology, comprising a VR simulation of the patient’s anatomy linked to a robotic interface for haptic force feedback. The study’s emphasis is on addressing the limitations of current systems, and the paper specifically focuses on the requirements, design, and prototyping of a haptic interface tailored for guide wires. The same author in [] discusses IR, a minimally invasive surgical technique, where guidewires and catheters are navigated through the vascular system under X-ray imaging. To enhance radiologist training in this procedure, the paper proposes a computer-assisted training environment for IR. The system integrates a VR simulation of the patient’s anatomy with a robotic interface offering haptic force feedback. The focus of the paper is on detailing the requirements, design, and prototyping of a specific aspect of the haptic interface dedicated to catheters. This involves a friction drive arrangement using two cylinders for translational tracking and force feedback, with an additional motor providing torque feedback. Integrated force and torque sensors in the cylinders enable direct measurement on the catheter, allowing for disturbance cancellation through a close-loop force control strategy.
The studies underscore the pivotal role of integrating VR and robotics in various medical domains. Benabid et al. [,] emphasize neurosurgery as a foundational platform for robotic applications, foreseeing integration with augmented reality (AR) and VR. Shi et al. [] focus on endovascular robotic systems in interventional surgery, introducing a novel VR training system for enhanced safety. Maresacux and Diana [] propose the convergence of surgery, endoscopy, and interventional radiology into hybrid therapies, leveraging robotics and computer sciences. Ni et al. [] address ultrasound-guided biopsy training with a VR simulation system, while Moix et al. [,] discuss quality training environments for interventional radiology, integrating VR simulation and robotic interfaces. These studies collectively showcase the potential for VR and robotics to transform medical practices, emphasizing improved safety, training efficacy, and patient outcomes.
The key emerging themes/patterns are reported in Table 6.
Table 6.
Key emerging themes suggested by the overviewed studies.
4.3.3. Further Considerations on the Integrations with the Robotics
During the overview of reviews on VR in radiology, a limitation in specific studies on robotics emerged, prompting further investigation. This limitation can be interpreted from two perspectives.
The first perspective concerns the role of radiology and imaging. For instance, in the intersection of robotic tele-surgery [,,] with Virtual Reality, the role of radiology may be less pronounced since Virtual Reality often utilizes optical sensors such as video endoscopes, digital lenses, and others.
The second perspective relates to regulations. It is necessary to consider the intended use of the device and the role of VR, which is the focus of our overview of reviews. The MDCG 2019-11 Guidance on Qualification and Classification of Software in Regulation (EU) 2017/745—MDR and Regulation (EU) 2017/746—IVDR clarifies this aspect decisively []. It states that “Virtual reality technology may be used to support a remote surgeon to control a surgical robot performing the surgical procedure. Telesurgery systems should be qualified as medical devices according to the road maps in the document. Remote control software used in combination with telesurgery robots is a software that drives or influences the use of a medical device. Communication modules themselves are not medical devices. Other modules that are intended to influence the surgery procedure are qualified as medical devices”.
It is evident that if VR modules are not directly used for this purpose but, for example, for other types of activities (such as mere support) and experiences, they do not fall under device regulations. Therefore, it is important in this paradigm and integration to consider both the role of radiology (whether present or not) and the intended use of the device, particularly focusing on its components and with a focus on VR, whether VR functions as a medical device or a mere component.
4.4. Synoptic Diagram
Figure 8 presents a synoptic diagram referencing the Tables and graphs included in this review. Figure 8B refers to Table 1, which imports perspectives on VR in radiology based on the review in [] of primary articles and studies. Figure 8C refers to instruments reporting standardization in this area by the FDA: Table 2 provides a dump of the authorization register for VR/AR devices, and Figure 2 and Figure 3. Figure 8D refers to trends described in four graphs (Figure 4, Figure 5, Figure 6 and Figure 7). Opportunities and limitations are, respectively, reported in Figure 8F,G, recalling Table 4 and Table 5. Following a need for further investigation on non-review studies on the integration of VR and radiology with robotics, to take stock (Figure 8H), Figure 8I refers to Table 6 with the emerged evidence. Table S1 (Figure 8) in the Supplementary Material provides the ANDJ checklist.
Figure 8.
Synoptic diagram.
4.5. Takeaway Message
Significant initiatives have involved the integration of Virtual Reality with digital radiology, driven by the characteristics and peculiarities of the sector. The integration has also extended to other technologies such as AI and AR, with robotics playing a minor role. The underlying message strongly encourages continued progress in this field, consolidating current experiences and addressing the ongoing challenges of technological innovation.
4.6. Limitations
This study employed PubMed and Scopus databases, concentrating on review studies through a narrative review of reviews to discern emerging themes and patterns, incorporating them into the discussion. It was also complemented with other targeted searches also based on direct access to institutional websites. Subsequent targeted research on these topics, including systematic reviews, can precisely monitor the progress made. Exploring in details national databases can additionally enhance knowledge in this domain by identifying local initiatives, with a particular emphasis on standardization and regulatory compliance.
5. Conclusions
The literature highlights significant opportunities in the integration of VR with radiology, often in tandem with AR and AI in medical imaging. Key areas include advancements in medical education, potential contributions in diagnostics, extended reality applications, evolution of user interfaces, innovative approaches such as VR-simulated workstations, 3D modeling, personalized learning, and simulation-based medical education. The convergence of radiology, digital health, and VR signals a paradigm shift that could unlock innovative approaches to medical imaging and patient care. However, emerging limitations and areas for broader investigation encompass technology constraints, obstacles to AI acceptance in interventional radiology, challenges in standardizing VR education, the need for regulatory adjustments, the development of adequate norms, and ethical concerns. In the field of robotic integration, advancements in neurosurgery, endovascular robotic systems, and proposals for hybrid image-guided minimally invasive therapies show promise.
Continued research, targeted investigations, regulatory initiatives, and technological refinements are emphasized as being crucial for harnessing opportunities and addressing challenges in the evolving field of medical imaging and healthcare.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/robotics13050069/s1, The ANDJ checklist is reported in Supplementary Material (s.1). For completeness, excerpts are reported in Supplementary Materials (s.2) related to the overviewed studies refs. [,,,,,,,,,,,,,,,,,,,]. For completeness, details are reported in Supplementary Materials (s.3) regarding the COTS reported in the study overviewed in [].
Author Contributions
Conceptualization, D.G. and A.L.; methodology, all; software, A.L.; validation, all; formal analysis, all; investigation, all; resources, all; data curation, all; writing—original draft preparation, all; writing—review and editing, D.G. and A.L.; visualization, A.L.; supervision, D.G; project administration, D.G.; funding acquisition, D.G. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding. APC was funded by D.G.
Conflicts of Interest
The authors declare no conflicts of interest.
List of Acronyms
| VR | Virtual Reality |
| AR | Augmented Reality |
| FDA | Food and Drug administration |
| DICOM | Digital Information and Communication |
| PACS | Picture Archiving and Communication System |
| RIS | Radiology Information System |
| CT | Computed Tomography |
| MRI | Magnetic Resonance Imaging |
| VAR | Virtual and Augmented Reality |
| ER | Extended Reality (1st definition) |
| XR | Extended Reality (2nd definition) |
| MR | Mixed Reality |
| HMD | Head Mounted Device |
| CAVE | Cave Automatic Virtual Environment |
| AI | Artificial Intelligence |
| SBME | Simulation-based medical education |
| UI | Unit Interface |
| IR | Interventional Radiology |
| COTS | Commercial off-the-shelf |
| MK | Microsoft Kinect |
| LMC | Leap Motion Controller |
References
- Kouijzer, M.M.T.E.; Kip, H.; Bouman, Y.H.A.; Kelders, S.M. Implementation of virtual reality in healthcare: A scoping review on the implementation process of virtual reality in various healthcare settings. Implement. Sci. Commun. 2023, 4, 67. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Erdilek, D.; Gümüştaş, B.; Efes, B.G. Digitalization era of dental education: A systematic review. Dent. Med. Probl. 2023, 60, 513–525. [Google Scholar] [CrossRef] [PubMed]
- Foronda, C.L.P.; Gonzalez, L.P.; Meese, M.M.M.; Slamon, N.; Baluyot, M.; Lee, J.M.; Aebersold, M.P. A Comparison of Virtual Reality to Traditional Simulation in Health Professions Education. Simul. Health J. Soc. Simul. Health 2023, 19, S90–S97. [Google Scholar] [CrossRef] [PubMed]
- Said, R.R.; Bin Heyat, B.; Song, K.; Tian, C.; Wu, Z. A Systematic Review of Virtual Reality and Robot Therapy as Recent Rehabilitation Technologies Using EEG-Brain–Computer Interface Based on Movement-Related Cortical Potentials. Biosensors 2022, 12, 1134. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Kanschik, D.; Bruno, R.R.; Wolff, G.; Kelm, M.; Jung, C. Virtual and augmented reality in intensive care medicine: A systematic review. Ann. Intensiv. Care 2023, 13, 81. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Osservatorio Terapie Avanzate. IL PORTALE ITALIANO DEDICATO ALL’INFORMAZIONE E ALLA DIVULGAZIONE SULLE TERAPIE AVANZATE. Available online: https://www.osservatorioterapieavanzate.it/innovazioni-tecnologiche/digital-health/realta-virtuale-tecnologie-dirompenti-al-servizio-della-medicina (accessed on 15 April 2024).
- Available online: https://www.fda.gov/medical-devices/digital-health-center-excellence/augmented-reality-and-virtual-reality-medical-devices?utm_medium=email&utm_source=govdelivery&utm_source=STAT+Newsletters&utm_campaign=1f31ee8897-health_tech_COPY_01&utm_medium=email&utm_term=0_8cab1d7961-1f31ee8897-151808433 (accessed on 15 April 2024).
- Žiak, P.; Holm, A.; Halička, J.; Mojžiš, P.; Piñero, D.P. Amblyopia treatment of adults with dichoptic training using the virtual reality oculus rift head mounted display: Preliminary results. BMC Ophthalmol. 2017, 17, 105. [Google Scholar] [CrossRef] [PubMed]
- Available online: https://www.dicomstandard.org/ (accessed on 15 April 2024).
- Pirrera, A.; Giansanti, D. Human–Machine Collaboration in Diagnostics: Exploring the Synergy in Clinical Imaging with Artificial Intelligence. Diagnostics 2023, 13, 2162. [Google Scholar] [CrossRef] [PubMed]
- DICOM Whole Slide Imaging (WSI). NEMA. Available online: http://dicom.nema.org/Dicom/DICOMWSI/ (accessed on 15 April 2024).
- Giansanti, D.; Grigioni, M.; D’Avenio, G.; Morelli, S.; Maccioni, G.; Bondi, A.; Giovagnoli, M.R. Virtual microscopy and digital cytology: State of the art. Ann. Ist. Super. Sanità 2010, 46, 115–122. [Google Scholar] [CrossRef] [PubMed]
- Kahn, C.E.; Carrino, J.A.; Flynn, M.J.; Peck, D.J.; Horii, S.C. DICOM and Radiology: Past, Present, and Future. J. Am. Coll. Radiol. 2007, 4, 652–657. [Google Scholar] [CrossRef] [PubMed]
- Guo, W.; Hu, G.; Yan, J.; Li, D. Analysis of DICOM and its application in teleradiology. J. Biomed. Eng. 2003, 20, 171–174. (In Chinese) [Google Scholar] [PubMed]
- Valenzuela, T.F.; Iaizzo, P.A. Post-procedure micro-CT analyses of coronary artery stenting in left main vessels of reanimated and perfusion-fixed human hearts. Biomed. Eng. Online 2023, 22, 27. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Available online: https://pubmed.ncbi.nlm.nih.gov/?term=%28Virtual+Reality%5BTitle%2FAbstract%5D%29+AND+%28Radiology%5BTitle%2FAbstract%5D%29&sort=date&size=200 (accessed on 15 April 2024).
- Javaid, M.; Haleem, A.; Singh, R.P.; Khan, S. Understanding roles of virtual reality in radiology. Internet Things Cyber-Phys. Syst. 2022, 2, 91–98. [Google Scholar] [CrossRef]
- Abramson, Z.; Thompson, D.; Goode, C.; Morin, C.E.; Daniels, S.; Choudhri, A.F.; Davidoff, A.M. Current and emerging 3D visualization technologies in radiology. Pediatr. Radiol. 2024. [Google Scholar] [CrossRef] [PubMed]
- Mustafa, A.R.; Moloudi, F.; Balasalle, E.; Lang, M.; Uppot, R.N. Virtual Reading Room for Diagnostic Radiology. Curr. Probl. Diagn. Radiol. 2023. [Google Scholar] [CrossRef] [PubMed]
- Available online: https://dictionary.cambridge.org/it/dizionario/inglese/virtual-reality (accessed on 15 April 2024).
- Available online: https://www.collinsdictionary.com/it/dizionario/inglese/virtual-reality (accessed on 15 April 2024).
- Available online: https://www.merriam-webster.com/dictionary/virtual%20reality (accessed on 15 April 2024).
- Yadav, S. Transformative Frontiers: A Comprehensive Review of Emerging Technologies in Modern Healthcare. Cureus 2024, 16, e56538. [Google Scholar] [CrossRef] [PubMed]
- Ammanuel, S.; Brown, I.; Uribe, J.; Rehani, B. Creating 3D models from Radiologic Images for Virtual Reality Medical Education Modules. J. Med. Syst. 2019, 43, 166. [Google Scholar] [CrossRef] [PubMed]
- Uppot, R.N.; Laguna, B.; McCarthy, C.J.; De Novi, G.; Phelps, A.; Siegel, E.; Courtier, J. Implementing Virtual and Augmented Reality Tools for Radiology Education and Training, Communication, and Clinical Care. Radiology 2019, 291, 570–580. [Google Scholar] [CrossRef] [PubMed]
- Mandalika, V.B.H.; Chernoglazov, A.I.; Billinghurst, M.; Bartneck, C.; Hurrell, M.A.; Ruiter, N.; Butler, A.P.H.; Butler, P.H. A Hybrid 2D/3D User Interface for Radiological Diagnosis. J. Digit. Imaging 2018, 31, 56–73. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Douglas, D.B.; Venets, D.; Wilke, C.; Gibson, D.; Liotta, L.; Petricoin, E.; Beck, B.; Douglas, R. Augmented Reality and Virtual Reality: Initial Successes in Diagnostic Radiology. In State of the Art Virtual Reality and Augmented Reality Knowhow; IntechOpen: London, UK, 2018. [Google Scholar]
- Hopper, K.D.; Iyriboz, A.T.; Wise, S.W.; Neuman, J.D.; Mauger, D.T.; Kasales, C.J. Mucosal Detail at CT Virtual Reality: Surface versus Volume Rendering. Radiology 2000, 214, 517–522. [Google Scholar] [CrossRef] [PubMed]
- Cramer, H.S.M.; Evers, V.; Zudilova, E.V.; Sloot, P.M.A. Context analysis to support development of virtual reality applications. Virtual Real. 2004, 7, 177–186. [Google Scholar] [CrossRef]
- King, F.; Jayender, J.; Bhagavatula, S.K.; Shyn, P.B.; Pieper, S.; Kapur, T.; Lasso, A.; Fichtinger, G. An Immersive Virtual Reality Environment for Diagnostic Imaging. J. Med. Robot. Res. 2016, 1, 1640003. [Google Scholar] [CrossRef]
- Ong, C.S.; Deib, G.; Yesantharao, P.; Qiao, Y.; Pakpoor, J.; Hibino, N.; Hui, F.; Garcia, J.R. Virtual Reality in Neurointervention. J. Vasc. Intervent. Neurol. 2018, 10, 17–22. [Google Scholar]
- Xin, M.; Lei, Z.; Volkau, I.; Weili, Z.; Aziz, A.; Ang, M.; Nowinski, W. A Virtual Reality Simulator for Remote Interventional Radiology: Concept and Prototype Design. IEEE Trans. Biomed. Eng. 2006, 53, 1696–1700. [Google Scholar] [CrossRef] [PubMed]
- Garg, T.; Loya, M.F.; Shrigiriwar, A. Virtual Reality and Its Applications in Interventional Radiology. Acad. Radiol. 2020, 27, 1495. [Google Scholar] [CrossRef] [PubMed]
- Venson, J.; Berni, J.A.; da Silva Maia, C.E.; da Silva, A.M.; d’Ornellas, M.C.; Maciel, A. A case-based study with radiologists performing diagnosis tasks in virtual reality. In MEDINFO 2017: Precision Healthcare through Informatics: Proceedings of the 16th World Congress on Medical and Health Informatics; IOS Press: Amsterdam, The Netherlands, 2018; Volume 245, p. 244. [Google Scholar]
- Javaid, M.; Haleem, A.; Khan, I.H. Virtual reality (VR) applications in dentistry: An innovative technology to embrace. Indian J. Dent. Res. 2020, 31, 666–667. [Google Scholar] [CrossRef] [PubMed]
- Goha, K.Y. Virtual reality applications in neurosurgery. In Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China, 17–18 January 2006; IEEE: New York, NY, USA, 2006; pp. 4171–4173. [Google Scholar]
- Noguera Aguilar, J.F. Digital imaging, virtual and augmented reality. Cir. Esp. 2024; in press. [Google Scholar] [CrossRef] [PubMed]
- Nakata, N.; Suzuki, N.; Hattori, A.; Hirai, N.; Miyamoto, Y.; Fukuda, K. Informatics in Radiology: Intuitive User Interface for 3D Image Manipulation Using Augmented Reality and a Smartphone as a Remote Control. RadioGraphics 2012, 32, E169–E174. [Google Scholar] [CrossRef]
- Available online: https://www.merriam-webster.com/dictionary/augmented%20reality (accessed on 15 April 2024).
- Spiegel, B.M.R.; Rizzo, A.; Persky, S.; Liran, O.; Wiederhold, B.; Woods, S.; Donovan, K.; Sarkar, K.; Xiang, H.; Joo, S.; et al. What Is Medical Extended Reality? A Taxonomy Defining the Current Breadth and Depth of an Evolving Field. J. Med. Ext. Real. 2024, 1, 4–12. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Solbiati, L.A. Augmented Reality: Thrilling Future for Interventional Oncology? Cardiovasc. Interv. Radiol. 2021, 44, 782–783. [Google Scholar] [CrossRef] [PubMed]
- Goo, H.W.; Park, S.J.; Yoo, S.-J. Advanced Medical Use of Three-Dimensional Imaging in Congenital Heart Disease: Augmented Reality, Mixed Reality, Virtual Reality, and Three-Dimensional Printing. Korean J. Radiol. 2020, 21, 133–145. [Google Scholar] [CrossRef] [PubMed]
- Takata, T.; Nakabayashi, S.; Kondo, H.; Yamamoto, M.; Furui, S.; Shiraishi, K.; Kobayashi, T.; Oba, H.; Okamoto, T.; Kotoku, J. Mixed Reality Visualization of Radiation Dose for Health Professionals and Patients in Interventional Radiology. J. Med. Syst. 2021, 45, 38. [Google Scholar] [CrossRef] [PubMed]
- Werner, H.; Dos Santos, J.R.L.; Ribeiro, G.; Júnior, E.A. Prenatal Phenotype of Down Syndrome Using 3-D Virtual Reality. J. Obstet. Gynaecol. Can. 2017, 39, 886–889. [Google Scholar] [CrossRef] [PubMed]
- Available online: https://www.sciencedirect.com/topics/engineering/head-mounted-device (accessed on 15 April 2024).
- Available online: https://www.techtarget.com/whatis/definition/CAVE-Cave-Automatic-Virtual-Environment (accessed on 15 April 2024).
- Jung, A.R.; Park, E.A. The Effectiveness of Learning to Use HMD-Based VR Technologies on Nursing Students: Chemoport Insertion Surgery. Int. J. Environ. Res. Public Health 2022, 19, 4823. [Google Scholar] [CrossRef] [PubMed]
- Combe, T.; Chardonnet, J.R.; Merienne, F.; Ovtcharova, J. CAVE and HMD: Distance perception comparative study. Virtual Real. 2023, 27, 2003–2013. [Google Scholar] [CrossRef] [PubMed]
- López-Ojeda, W.; Hurley, R.A. Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care. J. Neuropsychiatry 2021, 33, A4–A177. [Google Scholar] [CrossRef]
- Kang, S.L.; Shkumat, N.; Dragulescu, A.; Guerra, V.; Padfield, N.; Krutikov, K.; Chiasson, D.A.; Chaturvedi, R.R.; Yoo, S.J.; Benson, L.N. Mixed-reality view of cardiac specimens: A new approach to understanding complex intracardiac congenital lesions. Pediatr. Radiol. 2020, 50, 1610–1616. [Google Scholar] [CrossRef] [PubMed]
- Mehraeen, E.; SeyedAlinaghi, S.; Heydari, M.; Karimi, A.; Mahdavi, A.; Mashoufi, M.; Sarmad, A.; Mirghaderi, P.; Shamsabadi, A.; Qaderi, K.; et al. Telemedicine technologies and applications in the era of COVID-19 pandemic: A systematic review. Health Inform. J. 2023, 29, 14604582231167431. [Google Scholar] [CrossRef] [PubMed]
- Hayre, C.M.; Kilgour, A. Diagnostic radiography education amidst the COVID-19 pandemic: Current and future use of virtual reality (VR). J. Med. Imaging Radiat. Sci. 2021, 52, S20–S23. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Oulefki, A.; Agaian, S.; Trongtirakul, T.; Benbelkacem, S.; Aouam, D.; Zenati-Henda, N.; Abdelli, M.-L. Virtual Reality visualization for computerized COVID-19 lesion segmentation and interpretation. Biomed. Signal Process. Control 2021, 73, 103371. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Yeung, A.W.K.; Parvanov, E.D.; Hribersek, M.; Eibensteiner, F.; Klager, E.; Kletecka-Pulker, M.; Rössler, B.; Schebesta, K.; Willschke, H.; Atanasov, A.G.; et al. Digital Teaching in Medical Education: Scientific Literature Landscape Review. JMIR Med. Educ. 2022, 8, e32747. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Liu, J.; Lyu, L.; Chai, S.; Huang, H.; Wang, F.; Tateyama, T.; Lin, L.; Chen, Y. Augmented Reality Visualization and Quantification of COVID-19 Infections in the Lungs. Electronics 2024, 13, 1158. [Google Scholar] [CrossRef]
- Amara, K.; Aouf, A.; Kerdjidj, O.; Kennouche, H.; Djekoune, O.; Guerroudji, M.A.; Zenati, N.; Aouam, D. Augmented Reality for COVID-19 Aid Diagnosis: Ct-Scan segmentation based Deep Learning. In Proceedings of the 2022 7th International Conference on Image and Signal Processing and their Applications (ISPA), Mostaganem, Algeria, 8–9 May 2022. [Google Scholar]
- Benbelkacem, S.; Oulefki, A.; Agaian, S.; Zenati-Henda, N.; Trongtirakul, T.; Aouam, D.; Masmoudi, M.; Zemmouri, M. COVI3D: Automatic COVID-19 CT Image-Based Classification and Visualization Platform Utilizing Virtual and Augmented Reality Technologies. Diagnostics 2022, 12, 649. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Bhugaonkar, K.; Bhugaonkar, R.; Masne, N. The Trend of Metaverse and Augmented & Virtual Reality Extending to the Healthcare System. Cureus 2022, 14, e29071. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Tsai, T.Y.; Onuma, Y.; Złahoda-Huzior, A.; Kageyama, S.; Dudek, D.; Wang, Q.; Lim, R.P.; Garg, S.; Poon, E.K.W.; Puskas, J.; et al. Merging virtual and physical experiences: Extended realities in cardiovascular medicine. Eur. Heart J. 2023, 44, 3311–3322. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Ong, T.; Wilczewski, H.; Paige, S.R.; Soni, H.; Welch, B.M.; Bunnell, B.E. Extended Reality for Enhanced Telehealth during and Beyond COVID-19. JMIR Serious Games 2021, 9, e26520. [Google Scholar] [CrossRef] [PubMed]
- Available online: https://www.fda.gov/media/176814/download (accessed on 15 April 2024).
- Available online: https://www.fda.gov/media/176815/download (accessed on 15 April 2024).
- Available online: https://www.statista.com/statistics/1410751/vr-and-ar-medical-devices-approved-in-the-us-by-area/ (accessed on 15 April 2024).
- Available online: https://www.dicomdirector.com/recent-fda-device-reclassifications/ (accessed on 15 April 2024).
- Available online: https://www.dicomdirector.com/category/intravision-xr/ (accessed on 15 April 2024).
- Available online: https://www.fda.gov/media/160086/download (accessed on 15 April 2024).
- Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32017R0745 (accessed on 15 April 2024).
- Available online: https://health.ec.europa.eu/system/files/2023-10/md_mdcg_2023-4_software_en.pdf (accessed on 15 April 2024).
- Bini, F.; Franzò, M.; Maccaro, A.; Piaggio, D.; Pecchia, L.; Marinozzi, F. Is medical device regulatory compliance growing as fast as extended reality to avoid misunderstandings in the future? Health Technol. 2023, 13, 831–842. [Google Scholar] [CrossRef]
- The European Parliament and the Council of the Euroepan Union. Council Directive 93/42/EEC of 14 June 1993 Concerning Medical Devices. 1993. Available online: http://data.europa.eu/eli/dir/1993/42/oj (accessed on 15 April 2024).
- Baxter, C.; Carroll, J.A.; Keogh, B.; Vandelanotte, C. Seeking inspiration: Examining the validity and reliability of a new smartphone respiratory therapy exergame app. Sensors 2021, 21, 6472. [Google Scholar] [CrossRef] [PubMed]
- Franzò, M.; Pica, A.; Pascucci, S.; Serrao, M.; Marinozzi, F.; Bini, F. A Proof of Concept Combined Using Mixed Reality for Personalized Neurorehabilitation of Cerebellar Ataxic Patients. Sensors 2023, 23, 1680. [Google Scholar] [CrossRef]
- Williams, T.; Kennedy-malone, L.; Thompson, J.; Monge, E.C. The effect of an exergame on physical activity among olderadults residing in a long-term care facility: A pilot study. Geriatr. Nurs. 2022, 44, 48–53. [Google Scholar] [CrossRef] [PubMed]
- Pensieri, C.; Pennacchini, M. Overview: Virtual Reality in Medicine. J. Virtual Worlds Res. 2014, 7. [Google Scholar] [CrossRef]
- Available online: https://www.canhealth.com/2021/07/28/vr-radiology-platform-approved-by-health-canada/ (accessed on 15 April 2024).
- Denyer, D.; Tranfield, D. Producing a Systematic Review. In The Sage Handbook of Organizational Research Methods; Sage Publications Ltd.: New York, NY, USA, 2009. [Google Scholar]
- Sukhera, J. Narrative Reviews: Flexible, Rigorous, and Practical. J. Grad. Med. Educ. 2022, 14, 414–417. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- ANDJ Checklist. Available online: https://www.elsevier.com/__data/promis_misc/ANDJ%20Narrative%20Review%20Checklist.pdf (accessed on 3 June 2023).
- Giansanti, D. An Umbrella Review of the Fusion of fMRI and AI in Autism. Diagnostics 2023, 13, 3552. [Google Scholar] [CrossRef] [PubMed]
- Available online: https://pubmed.ncbi.nlm.nih.gov/?term=%28Virtual+Reality%5BTitle%2FAbstract%5D%29+AND+%28Radiology%5BTitle%2FAbstract%5D%29&filter=pubt.meta-analysis&filter=pubt.review&filter=pubt.systematicreview&sort=date&size=200 (accessed on 15 April 2024).
- Sutherland, J.; Belec, J.; Sheikh, A.; Chepelev, L.; Althobaity, W.; Chow, B.J.W.; Mitsouras, D.; Christensen, A.; Rybicki, F.J.; La Russa, D.J. Applying Modern Virtual and Augmented Reality Technologies to Medical Images and Models. J. Digit. Imaging 2018, 32, 38–53. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Elsayed, M.; Kadom, N.; Ghobadi, C.; Strauss, B.; Al Dandan, O.; Aggarwal, A.; Anzai, Y.; Griffith, B.; Lazarow, F.; Straus, C.M.; et al. Virtual and augmented reality: Potential applications in radiology. Acta Radiol. 2020, 61, 1258–1265. [Google Scholar] [CrossRef] [PubMed]
- Gelmini, Y.P.; Duarte, M.L.; de Assis, A.M.; Junior, J.B.G.; Carnevale, F.C. Virtual reality in interventional radiology education: A systematic review. Radiol. Bras. 2021, 54, 254–260. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- von Ende, E.; Ryan, S.; Crain, M.A.; Makary, M.S. Artificial Intelligence, Augmented Reality, and Virtual Reality Advances and Applications in Interventional Radiology. Diagnostics 2023, 13, 892. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Gamba, I.A.; Hartery, A. The Virtual Reality Radiology Workstation: Current Technology and Future Applications. Can. Assoc. Radiol. J. 2024. [Google Scholar] [CrossRef] [PubMed]
- Chytas, D.; Salmas, M.; Demesticha, T.; Noussios, G.; Paraskevas, G.; Chrysanthou, C.; Asouhidou, I.; Katsourakis, A.; Fiska, A. A Review of the Use of Virtual Reality for Teaching Radiology in Conjunction with Anatomy. Cureus 2021, 13, e20174. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Iannessi, A.; Marcy, P.-Y.; Clatz, O.; Bertrand, A.-S.; Sugimoto, M. A review of existing and potential computer user interfaces for modern radiology. Insights Imaging 2018, 9, 599–609. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Gurgitano, M.; Angileri, S.A.; Rodà, G.M.; Liguori, A.; Pandolfi, M.; Ierardi, A.M.; Wood, B.J.; Carrafiello, G. Interventional Radiology ex-machina: Impact of Artificial Intelligence on practice. Radiol. Med. 2021, 126, 998–1006. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Dankelman, J.; Wentink, M.; Grimbergen, C.A.; Stassen, H.; Reekers, J. Does Virtual Reality Training Make Sense in Interventional Radiology? Training Skill-, Rule- and Knowledge-Based Behavior. Cardiovasc. Interv. Radiol. 2004, 27, 417–421. [Google Scholar] [CrossRef] [PubMed]
- Kukla, P.; Maciejewska, K.; Strojna, I.; Zapał, M.; Zwierzchowski, G.; Bąk, B. Extended Reality in Diagnostic Imaging—A Literature Review. Tomography 2023, 9, 1071–1082. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Patel, T.Y.; Bedi, H.S.; Deitte, L.A.; Lewis, P.J.; Marx, M.V.; Jordan, S.G. Brave New World: Challenges and Opportunities in the COVID-19 Virtual Interview Season. Acad. Radiol. 2020, 27, 1456–1460. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Ravindran, B. Innovations in the Management of the Difficult Airway: A Narrative Review. Cureus 2023, 15, e35117. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Guimarães, B.; Tsisar, S.; Diniz, J.M.; Madeira, M.D.; Ferreira, M.A. Rethinking Anatomy: How to Overcome Challenges of Medical Education’s Evolution. Acta Med. Port. 2017, 30, 134–140. [Google Scholar] [CrossRef] [PubMed]
- Zhao, Z.; Ma, Y.; Mushtaq, A.; Radhakrishnan, V.; Hu, Y.; Ren, H.; Song, W.; Tse, Z.T.H. Engineering functional and anthropomorphic models for surgical training in interventional radiology: A state-of-the-art review. Proc. Inst. Mech. Eng. Part H J. Eng. Med. 2022, 237, 3–17. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- McBain, K.A.; Habib, R.; Laggis, G.; Quaiattini, A.; Ventura, N.M.; Noel, G.P.J.C. Scoping review: The use of augmented reality in clinical anatomical education and its assessment tools. Anat. Sci. Educ. 2021, 15, 765–796. [Google Scholar] [CrossRef] [PubMed]
- Singhal, I.; Kaur, G.; Neefs, D.; Pathak, A.; Singhal, D. A Literature Review of the Future of Oral Medicine and Radiology, Oral Pathology, and Oral Surgery in the Hands of Technology. Cureus 2023, 15, e45804. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Dammann, F. Bildverarbeitung in der Radiologie. Rofo 2002, 174, 541–550. [Google Scholar] [CrossRef] [PubMed]
- Romeny, B.M.T.H.; Zuiderveld, K.J.; Van Waes, P.F.G.M.; Van Walsum, T.; Van Der Weijden, R.; Weickert, J.; Stokking, R.; Wink, O.; Kalitzin, S.; Maintz, T.; et al. Advances in three-dimensional diagnostic radiology. J. Anat. 1998, 193, 363–371. [Google Scholar] [CrossRef] [PubMed]
- Rooney, M.K.; Zhu, F.; Gillespie, E.F.; Gunther, J.R.; McKillip, R.P.; Lineberry, M.; Tekian, A.; Golden, D.W. Simulation as More Than a Treatment-Planning Tool: A Systematic Review of the Literature on Radiation Oncology Simulation-Based Medical Education. Int. J. Radiat. Oncol. 2018, 102, 257–283. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Alvarez-Lopez, F.; Maina, M.F.; Saigí-Rubió, F. Use of Commercial Off-The-Shelf Devices for the Detection of Manual Gestures in Surgery: Systematic Literature Review. J. Med. Internet Res. 2019, 21, e11925. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Available online: https://eumdr.com/ (accessed on 15 April 2024).
- Shi, C.; Ishihara, H. Performance Evaluation of a Vascular Interventional Surgery Robotic System with Visual-Based Force Feedback. Machines 2023, 11, 727. [Google Scholar] [CrossRef]
- Marescaux, J.; Diana, M. Next step in minimally invasive surgery: Hybrid image-guided surgery. J. Pediatr. Surg. 2015, 50, 30–36. [Google Scholar] [CrossRef] [PubMed]
- Ni, D. A virtual reality simulator for ultrasound-guided biopsy training. IEEE Comput. Graph. Appl. 2011, 31, 36–48. [Google Scholar] [CrossRef] [PubMed]
- Moix, T.; Ilic, D.; Fracheboud, B.; Zoethout, J.; Bleuler, H. A real-time haptic interface for interventional radiology procedures. Stud. Health Technol. Inform. 2005, 111, 329–333. [Google Scholar] [PubMed]
- Moix, T.; Ilic, D.; Bleuler, H.; Zoethout, J. A haptic device for guide wire in interventional radiology procedures. Med. Meets Virtual Real. 14 2006, 119, 388–392. [Google Scholar]
- Benabid, A.L.; Hoffmann, D.; Ashraf, A.; Koudsie, A.; Esteve, F.; Le-Bas, J.F. La robotisation de la neurochirurgie: État actuel et perspectives d’avenir: The robotization of neurosurgery: State of the art and future outlook. Bull. Acad. Natl. Med. 1997, 181, 1625–1636. [Google Scholar] [PubMed]
- Benabid, A.L.; Hoffmann, D.; Ashraf, A.; Koudsie, A.; Esteve, F.; Le Bas, J.F. La robotisation de la neurochirurgie: État actuel et perspectives d’avenir: Robotics in neurosurgery: Current status and future prospects. Chirurgie 1998, 123, 25–31. [Google Scholar] [CrossRef] [PubMed]
- Zhang, Q.; Liu, Q.; Duan, J.; Qin, J. Research on Teleoperated Virtual Reality Human–Robot Five-Dimensional Collaboration System. Biomimetics 2023, 8, 605. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Rudiman, R.; Mirbagheri, A.; Candrawinata, V.S. Assessment of robotic telesurgery system among surgeons: A single-center study. J. Robot. Surg. 2023, 17, 2757–2761. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Kazemzadeh, K.; Akhlaghdoust, M.; Zali, A. Advances in artificial intelligence, robotics, augmented and virtual reality in neurosurgery. Front. Surg. 2023, 10, 1241923. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Available online: https://health.ec.europa.eu/system/files/2020-09/md_mdcg_2019_11_guidance_qualification_classification_software_en_0.pdf (accessed on 15 April 2024).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).