Next Article in Journal
Dynamic Energy Efficient Control of Induction Machines Using Anticipative Flux Templates
Next Article in Special Issue
Holonic Reengineering to Foster Sustainable Cyber-Physical Systems Design in Cognitive Manufacturing
Previous Article in Journal
Structural Crack Detection and Recognition Based on Deep Learning
Previous Article in Special Issue
Development of an Automatic Low-Cost Air Quality Control System: A Radon Application
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Applicability of Clinical Decision Support in Management among Patients Undergoing Cardiac Surgery in Intensive Care Unit: A Systematic Review

by
Miguel Pereira
1,2,
Patricia Concheiro-Moscoso
3,*,
Alexo López-Álvarez
1,
Gerardo Baños
1,
Alejandro Pazos
2,4 and
Javier Pereira
3,4
1
Service of Anesthesiology, Resuscitation, Intensive Care, Álvaro Cunqueiro Hospital, 36213 Vigo, Spain
2
CITIC, RNASA-IMEDIR Group, Computer Science Faculty, University of A Coruña, Elviña, 15071 A Coruña, Spain
3
CITIC, TALIONIS Group, Elviña Campus, University of A Coruña, 15071 A Coruña, Spain
4
Biomedical Research Institute of A Coruña (INIBIC), University Hospital Complex of A Coruña (CHUAC), 15006 A Coruña, Spain
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(6), 2880; https://doi.org/10.3390/app11062880
Submission received: 19 February 2021 / Revised: 18 March 2021 / Accepted: 20 March 2021 / Published: 23 March 2021
(This article belongs to the Special Issue Advances in Information and Communication Technologies (ICT))

Abstract

:
The advances achieved in recent decades regarding cardiac surgery have led to a new risk that goes beyond surgeons’ dexterity; postoperative hours are crucial for cardiac surgery patients and are usually spent in intensive care units (ICUs), where the patients need to be continuously monitored to adjust their treatment. Clinical decision support systems (CDSSs) have been developed to take this real-time information and provide clinical suggestions to physicians in order to reduce medical errors and to improve patient recovery. In this review, an initial total of 499 papers were considered after identification using PubMed, Web of Science, and CINAHL. Twenty-two studies were included after filtering, which included the deletion of duplications and the exclusion of titles or abstracts that were not of real interest. A review of these papers concluded the applicability and advances that CDSSs offer for both doctors and patients. Better prognosis and recovery rates are achieved by using this technology, which has also received high acceptance among most physicians. However, despite the evidence that well-designed CDSSs are effective, they still need to be refined to offer the best assistance possible, which may still take time, despite the promising models that have already been applied in real ICUs.

1. Introduction

Advances in cardiac surgery have enabled the performance of these procedures in patients with the most complex cardiac pathologies and with the highest perioperative risks. These patients are likely to experience complications during the postoperative period. Cardiogenic shock (CS), low cardiac output syndrome (LCOS), stroke, kidney failure, gastrointestinal problems, and respiratory distress are the main issues that may arise during this period, entailing the highest mortality [1,2,3].
Patients undergoing heart surgery require long stays in intensive care units (ICUs), compared to other types of surgery, due to the aforementioned complications [4,5]. These include vasospasm, altered platelet–endothelial cell interactions, and a generalized inflammatory response due to blood contacting the synthetic surfaces of the bypass equipment [6,7,8]. The result is low flow in the microcirculation of the heart, brain, and other organs, which may lead to organ dysfunction [9,10]. In addition, these patients demand the use of broad resources during their stay, such as high-level surveillance and monitoring and a quick analysis of the parameters or adjustments in their medical treatment [11,12]. The assistance of vital support for these patients is made through the maintenance of vital signs in a target range, the coordination of early therapy directed by objectives in cardiogenic shock, and the hemodynamic stabilization of LCOS. These techniques can speed up postoperative recovery, decrease hospital stays or the use of mechanical ventilation, and reduce ICU days [13,14].
In ICUs, physicians must control these parameters, care for subjects’ needs, and prevent complications in order to achieve the optimal conditions of these patients. Therefore, professionals must make elaborate decisions in some situations and make modifications in treatment [15,16,17]. These situations cause high pressure and intense burden that can cause medical errors and may negatively influence patients’ outcomes [18,19]. According to Farzi et al., ICU patients are exposed to an average of 1.7 errors per day; specifically, medication errors represent 78% of serious medical errors [20]. The application of artificial intelligence techniques can provide support to health professionals in decision making related to the treatment of patients [21,22]. The use of clinical decision support systems (CDSSs) can be very appropriate, supporting doctors to improve the clinical progress of patients [23,24]. The development and impact of these systems in the different fields of medicine have been very important [25].

1.1. Background of Decision Support Systems

CDSSs are programs based on artificial intelligence (AI) and machine learning (ML) in statistical patterns [26]. CDSSs are a tool increasingly used by clinicians and can involve difficulties in understanding the logic used by AI or integrating different clinical devices [27]. CDSSs also have two other classifications: active or passive based on the design and action of the system. The temporal classification depends on the system’s moment of intervention [28].
One of the main objectives of CDSSs is the analysis of patient databases, the extraction of prognostic variables, and the determination of factors to know a patient’s evolution [29]. Accordingly, several studies have focused on the Medical Information Mart for Intensive Care III (MIMIC-III), being the largest free access clinical database associated with ICUs [30]. Reports such as those by Bashar et al. have highlighted that MIMIC-III, using a large amount of data, including laboratory tests, procedures, medications, caregivers’ notes, image reports, and mortality, allows us to improve relevant clinical outcomes [31,32].
Another type of CDSS focuses on patient safety and drug administration [33]. The Computerized Physician Order Entry (CPOE) offers support to avoid errors in the dosages and improves the adjustment according to a patient’s comorbidities [34,35]. Databases are also important in ICUs, because they can enhance learning about the knowledge of the evolution and act in advance to prevent or act in each clinical situation [36]. Analysis of data has provided prognostic or evolutionary factors that have allowed the improvement of clinical results [37]. CDSSs can analyze different information obtained from electronic health records (EHRs) such as the sociodemographic, social, and epidemiological data of patients [38]. EHRs create alerts related to early diagnosis and trends that warn about bad prognosis indicators, allowing early modifications in treatment and modifications in clinical evolution [34,39]. CDSSs can be combined with other devices. Some studies have concluded that the combination of CDSSs and CPOE can be considered the most powerful tool for the prevention and reduction in potentially dangerous errors and for greater adjustment according to a patient’s comorbidities [40,41].
Some reviews related to CDSSs have been conducted, examining the outcomes associated with CDSSs and CPOE in inpatient settings, but few have focused on the impact that these systems have on cardiac patients in ICUs. Reviews focused on cardiac patients refer only to the economic costs and benefits of CDSSs [42,43]. Another one of these reviews focused on assessing the costs of hospitalization [44]. McKibbon et al. reviewed the effectiveness of these tools on patients in ICUs [45]. Sutton et al. analyzed the benefits and risks of CDSSs under a global point of view [46]. The remaining reviews focused specifically on pediatric patients [47,48,49].

1.2. Objectives

Given the importance of knowing the impact of these tools, this review aimed to determine the impact of clinical decision systems on cardiac patients in ICUs. The specific objectives were: (1) to examine and describe the evolution, detection of medical complications, interventions, and treatment response in the postoperative period of cardiac surgery; (2) to describe the rating and satisfaction of health professionals regarding the use of decision systems in ICUs.

2. Materials and Methods

The authors conducted this review between 2019 and 2020. This review was guided following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [50] (see File S1). Relevant studies were selected and analyzed regarding clinical decision support, and a summary of their findings is shown in the Results section.

2.1. Eligibility Criteria

In this review, we decided to include only those studies that (1) studied ICU patients of any age with cardiac pathologies and associated problems; (2) analyzed the use of EHRs, CPOE, or MIMIC-III in the data systems’ inpatient follow-up; (3) described the combination of CDSSs with previous systems for the improvement of healthcare; (4) provided predictive values for the implementation of these tools in ICUs. Articles that did not meet the following requirements were excluded: (1) articles not published in English, (2) articles without metadata, and (3) studies not published between 2001 and 2020.

2.2. Search Strategy

A search was conducted to find relevant published literature related to alert systems and cardiac patients in ICUs (2001–present). The search was performed on three databases: PubMed, Web of Science, and CINAHL (see Table S1). Moreover, scientific meetings proceedings or textbooks on Google Scholar were reviewed to identify significant publications about these topics.
The selection of studies was carried out through an iterative process to identify possible additional studies. In addition, the Boolean operators “OR” and “AND” were used, and some filters such as English language restrictions and publication date restrictions were employed.
The search combined different controlled terms (Mesh) (see Appendix A) for each database, as well as natural language. The main terms used for the search were: (“Intensive Care Units” OR “Critical Care”) AND (“Artificial Intelligence” OR “Big Data”) AND (“Electronic Medical Record” OR “Computerized Medical Record” OR “Clinical Decision Support” OR “Computerized physician order entry” OR “Database”) AND (“cardiogenic shock” OR “post-cardiac”). In addition, some additional articles were found for possible inclusion in the review through the reference section of full-text articles and related systematic revisions.

2.3. Study Selection

A total of 499 results were obtained in the literature search, including 462 from the search and 37 from the bibliographies of other studies. After eliminating duplicates, two authors read the titles and abstracts generated by the search strategy independently, but at the same time, in order to identify eligible articles and to maintain consistency in the review. Thus, they excluded all studies that did not fulfill the selection criteria determined in the review. When the eligibility and relevance of articles were unclear, they were discussed with the primary authors, who examined in detail the study according to the eligibility criteria. In some situations, they contacted the authors of these researchers for the clarification of some questions. So, the authors excluded 301 articles because they were not focused on the review topic.
For the first review, 349 articles were selected, whereas 48 were collected in the second review; finally, 22 results were included. In the second and third revisions, the authors evaluated the full texts and determined the final set of included studies. Figure 1 shows the selection process.

2.4. Data Extraction and Quality Assessment

Two researchers independently undertook data abstraction from each study. Data were abstracted onto a customized data extraction sheet. The variables included: author and year; the title of the study; country of origin; type and number sample; event identified; type of CDSS; study associated with the database, CPOE, and EHR; description (aim of study and results). The key findings from each study were summarized and presented in tables.
The reviewers coded the variables and resolved any disputes through mutual discussion. We followed three main steps in conducting an interpretive synthesis of our findings: (1) noting the range of functions and the uses of alert systems to promote/improve the situation in ICUs in cardiac patients, (2) developing a synthesis of the findings of included studies, and (3) exploring the relationships in the findings. Automated alerts were used all along the study process in order to keep the review up to date.
The reviewers assessed the methodological quality of the included studies, based on the criteria of the Effective Public Health Practice Project (EPHPP). This tool was employed for evaluating quantitative studies by previous systematic reviews. Studies are rated based on six components: (a) selection bias, (b) study design, (c) confounders, (d) blinding, (e) data collection methods, and (f) withdrawal and drop-outs.

2.5. Statistical Analysis

Each study was classified according to whether it was a CDSS, CPOE, EHR, or database system, as well as a combination of these decision support systems. On the contrary, the studies were grouped by the measurement of the results; thus, they were grouped according to development forecast, medication errors, warning systems, standardization of the protocols, adjustment to the objectives, cost reduction, and acceptance by health professionals.

3. Results

3.1. Study Characteristics

Twenty-two studies met our inclusion criteria. Table 1 summarizes and shows the characteristics of the studies. Fourteen studies evaluated the functionality of CDSSs in ICUs [51,52,53,54,55,56,57,58,59,60,61,62,63,64], three examined the applicability of databases in ICUs [65,66,67], one studied investigated the usefulness of EHRs [68], and another one considered CPOE [69]. Lastly, three analyzed the function of combinations of CDSS/CPOE and CDSS/EHR [70,71,72].
Fifteen studies involved patients over 18 years [51,52,53,54,55,57,58,59,61,64,65,66,67,68,69], five studies focused on pediatric patients [56,63,70,71,72], one used data from both populations [62], and examined professionals [60]. Most studies were conducted in the United States [51,52,55,56,58,62,65,66,67,68], Germany [64,72], and the United Kingdom [53,59,63]. Moreover, one was developed each in Spain [69], Israel [71], France [70], Australia [60], Sweden [61], Japan [54], and Canada [57].
The publication dates of these studies ranged from 2006 to 2018. Seven studies focused on the development and validation of information systems [51,53,57,59,64,66,72], five studies used retrospective analysis [52,55,56,58,67], three were prospective cohort studies [63,69,71], two studies conducted had an experimental design [60,65], and one was a controlled trial [54,61]; the remaining were a performance study [70], a multicenter study [62], and an observational cohort study [68].
The results of this review were organized according to the application area (see Table 2). Therefore, they were grouped into six main blocks: development forecast, medication errors, warning systems, standardization and compliance with protocols, precise adjustment to objectives, cost reduction, and acceptance. Table 2 shows the classification of the results.

3.2. Thematic Categories

3.2.1. Development Forecast

Five studies examined the use of CDSSs as a tool to predict the evolution that patients may have after heart surgery [55,56,57,67,68]. All five positive results obtained on the use of support systems to assess the evolution of patients in ICUs by analyzing multiple biomedical parameters [55,56,57,67,68]. Jalali et al. stated that the use of CDSSs can allow us to detect a rapid deterioration of a patient and be able to predict and achieve better results of concordance compared to classic scales of the sequential organ failure (SOFA) score and the simplified acute physiology score (SAPS) II [55]. The use of CDSSs, through the analysis of variables and clinical data associated with the function of the organs, results in a 45% higher F-score than the more classic tools (SOFA and SAPS-II are 26 and 29%, respectively) [55].
Another study by Jalali et al. involved the development of a CDSS for the prediction of periventricular leukomalacia, resulting in improved survival rates of neonates who underwent cardiac surgery. Survival rates were improved due to the average reduction in the time between surgery and diagnosis to six days. In addition, the results showed a high F-score (0.8) for the way the system ranks [56].
Rojas et al. assessed the probability of needing readmission in ICUs with the development of a prediction model using automatic learning techniques. With the use of the machine-learning-derived model, a lower area of the curve (0.76) was obtained, which was more favorable than the “Stability and Workload Index for Transfer “(SWIFT) score (0.65) or the “Modified Early Warning Score” (MEWS) (0.58). The results showed that this model better predicted ICU readmission compared to the SWIFT score and the MEWS. In addition, it had a higher area under the receiver operating curve (AUC) for predicting readmissions (p < 0.001) [68]. Other studies proved the effectiveness of these support systems in predicting the evolution of the patient in the weaning process and with the MIMIC-II [57,67].

3.2.2. Medication Errors

Four studies [63,69,70,71] focused on the analysis of the performance of support systems, specifically on the tools applied to CPOE systems in the prevention of errors in the pharmacological treatment of patients in ICUs. In general terms, these studies evidence an improvement in hospital care after the use of CPOE, such as a reduction in errors observed after its application [69,71].
Three of the studies indicate clinically significant changes in the incidence of medication errors [69,70,71]. Vardi’s study reported that before CPOE use, there were three errors for every 13,142 orders, while after its application, no medical errors were found [71]. Armada et al. found a reduction in errors from 92 to 98% in two experimental periods [69]. Gouyon et al. combined CPOE and a CDSS to avoid medicals errors for improving patient care safety. Approximately 30–40% of neonates had at least one of the licensed prescriptions [70].
In addition, the studies refer to the common causes of medical errors [63,69,70]. Armada et al. determined that some factors, such as lapses of health professionals, a lack of information, or inappropriate use of the computer system, can cause medical errors [69]. Other studies indicate that medical errors are caused by the inadequate selection of the dosage of some drugs [63,70].
Two studies analyzed the types of errors found; the most frequent errors were found to be mistakes in the name of the drug, the number of doses, or the units of measurement of doses [69,71]. These aspects were reduced with the use of support systems. Finally, one study reported that with the applicability of the CPOE system, the time of administration of drugs reduced from 14 min 42 s (standard deviation, 05:03) to 2 min 14 s (standard deviation, 00:39) [71].

3.2.3. Warning Systems: Early Detection and Early Action

Four studies analyzed the incorporation of CDSSs into surveillance and continuous analysis to allow the fast detection of clinical alterations [51,58,65,72]. Two studies examined the use of CDSSs in cardiac surgery patients. These systems monitored and controlled different parameters, such as blood glucose levels, or the presence of some conditions, such as the automated systematic inflammatory response syndrome (ARS) [58,72]. One of the studies reported that the system effectively warned healthcare professionals about B-blocker therapy before the operation and alerted them to the B-blocker restart [58]. Wulff et al. demonstrated a high agreement between the system and health professionals. The results showed a sensitivity of 1.00, a specificity of 0.94, and a kappa of Cohen of 0.92 [72].
Aushev et al. developed an automatic learning algorithm (ShockOmics) for predicting mortality in patients with cardiogenic shock for early detection. The results reported that the system had high sensitivity and specificity. Thus, an early alert reduced the risk of mortality in the acute phase of cardiogenic and septic shock, improving patients’ evolution [65]. Another study analyzed the applicability of VentAssit as an alert system, which resulted in changes in the pressure support prescription for mechanically ventilated patients using the real-time measurement of power breathing. The results demonstrated an agreement with the intensivist’s decision [51].

3.2.4. Standardization and Compliance with Protocols

Three studies included in the review examined the use of support systems as a necessary tool in the application and diagnostics of complex protocols [54,57,64]. Two studies reported that the application of a CDSS, as an essential tool for different established protocols, can improve decision making and diagnostics compared to traditional protocols [54,57].
Hsu et al. reported that the use of a CDSS helped health professionals to make decisions about those patients who presented a clinical situation that was suitable for being detested [54]. Likewise, these advanced protocols promoted a better evolution of patients through the improvement of the different biomedical parameters [54].
On the contrary, Zaslansky et al. proved CDSSs can be helpful in the diagnosis and the implementation of protocols for the improvement of treatments. The results presented that 60% of the cases following the recommendations of the protocols. These protocols are characterized by their parameters, such as performance assessment or benchmarking [64].

3.2.5. Precise Adjustment to Objectives

Six studies analyzed the applicability of these systems for maintaining biological constants within a more precise target range [51,52,53,54,59,61]. Five of these studies reported that the application of CDSSs kept patients’ constants stable, improving the evolution of the patients who were submitted to cardiac surgery [51,52,53,54,59].
Hsu et al. reported that CDSSs helped to maintain the stability of the biomedical parameters of the patients in the study group compared to those of the patients in the control group, resulting in a statistically significant relationship (p < 0.01) [54]. Moreover, Campion et al. determined the applicability of a CDSS for administering or adjusting insulin doses. The results showed that the recommended doses were accepted to a greater extent (83%) than higher doses (78%), with a statistically significant relationship (p < 0.001) [52].
Another field of application deals with hemodynamic parameters. Monitors such as pulse wave cardiac output lithium dilution cardiac output (LIDCOPLUS) provide computational intelligence to facilitate clinical decision making. Two studies proved LIDCOPLUS to be useful for patients undergoing cardiac surgery to maintain hemodynamic constants by assessing continuous monitoring and suggesting measures needed to keep them in range. In vasoactive drug infusion, the system modifies the doses or proposes a dose modification, measuring the improvement in the quality and efficiency of healthcare [53,59]. Likewise, VenAssit achieved a range of 84% by stabilizing six parameters such as plateau pressure, tidal volume, respiratory rate, Wob, tidal end CO2, and O2 saturation [51].
Finally, Sondergaard et al. used a target-directed therapy (TGT) to diagnose and administration a real-time pharmacological treatment regularly used. The results showed that there was no difference in the mean percentage time spent in the target zone (36.7% in control group and 35.5% in the intervention group), and there were no differences in the fluid balance, but there was a high level of concordance between both groups [61].

3.2.6. Cost Reduction

Three studies analyzed the use of CDSSs in reducing healthcare costs [65,68,69]. All the studies reported that CDSSs provide real-time diagnostic and therapeutic advice through the continuous monitoring of patients in cardiovascular dynamics, promoting a reduction in health costs. Its use has reduced medical errors and has shown a hospital stay reduction (length of stay (LOS)) and mortality [65,68,69].
Rojas et al. implemented a model of readmission in the ICU in real time. The results showed that 11% of the readmissions occurred during hospitalization; there was a greater probability of receiving more interventions and medications, which promoted a higher-quality stay [68]. One of the studies examined the use of CPOE in medical error preventions, resulting in a reduction in hospital stays and improved healthcare [69]. Aushev et al. concluded that identifying the most relevant features of patients with cardiogenic shock by CPOE reduces mortality rates and results in improved patient conditions, reduced burden, and reduced hospital care [65].

3.2.7. Acceptance

Six studies analyzed the acceptance of health professionals about support systems in clinical practice [52,53,59,60,62,69]. Four studies reported that these support systems can be accepted in the different fields of both treatments and diagnoses [52,53,59,69]. The recommendations of these support systems were accepted by the majority of critical care professionals, and they were considered a useful tool in clinical practice. Moreover, the combination of these systems was valued positively [69]. On the contrary, few studies showed negative results about the system’s use in clinical practice but suggested the system’s complexity and the overload of work [60,62].

4. Discussion

This review focused on the applicability of CDSSs, databases, CPOE, and EHRs in cardiac surgery patients in ICUs. The objectives were focused on summarizing the recent scientific evidence on this subject in order to investigate clinical decision support systems. Decision-making aids have been studied in different fields and types of patients.
The results showed an emerging area associated with the development forecast. Some studies referred to CDSSs, analyzing the predisposing parameters and supporting the forecast of the evolution and the readmission that a patient may present [56,67,68]. CDSSs use multiple parameters to determine the prognostics, such as patient characteristics, comorbidities, reasons for admission, and scales [55,73].
Specifically, the studies of Jalali et al. referred to the prediction of development in said studies. Both studies focused on patients with neurocritical and periventricular leukomalacia patients. They reported that a rapid prediction of a patient’s development can reduce mortality levels or hospital stay, among others [55,56].
The databases through CDSSs, including the parameters, proved their usefulness in predicting evolution, such as demographic data, laboratory data, and admission diagnoses [57,67]. Some reviews support the above. These reviews focused extensively on analyzing the prediction ranges of tools such as databases or CDSSs [74,75].
Another result that emerged strongly in the selected articles was medical errors. Specifically, the tools applied to CPOE systems were assessed in relation to their strong impact on the prevention of drug-related errors [63,69,70,71]. According to the evidence, CPOE tools prevent the wrong administration of drugs and help to make dosage adjustments considering comorbidities, which are among the most common confounding factors [76,77,78]. These dose modifications could eventually lead to a reduction in critical events such as cardiorespiratory arrest [71].
In addition, the results indicate that drug administration times were significantly reduced after the use of CPOE. Among the studies that were analyzed, the improvement in healthcare after the use of CPOE is meaningful, since errors of administration were recorded before and after its application, and a reduction was observed [63,69,70,71]. The reduction in the incidence of drug administration errors and the reduction in time to administration is of paramount importance in the pandemic situation because of the shortage in resources in critical care settings, and it must not be overlooked [79,80]. Although this situation does not directly affect the tasks usually performed by physicians or nursing professionals, it is considered one of the most limiting factors in providing the necessary care on time, so any tool capable of alleviating burdens should be considered potentially useful [78].
Moreover, the results suggest that these tools can detect difficulties in a patient’s situation for rapid action [54,64,65]. Considering the evidence, CDSSs and EHRs allow continuous monitoring for detecting clinical alterations at the precise moment they take place. This is relevant in postoperative patients, as they have a greater risk of suffering significant complications [79].
CDSSs also offer a precise adjustment of dosage or flux to maintain a variable in the desired range [51,52,53,54,59,61]. Some examples of the already developed CDSSs on this subject matter belong to the field of hemodynamic advanced measurement devices, such as cardiac output (CO) [53,59]. These studies dealt with the utilization of a CDSS combined with a continuous monitor of cardiovascular function [52,54]. The systems were able to select and advise reasonable treatments under different clinical conditions [51].
These systems are able to select and advise reasonable treatments under different clinical conditions. However, some of the analyzed results showed no significant statistical differences, and the lack of significant differences should not impede the relevance of these findings [61]. It is remarkable to find such high concordance between specialists trained in intensive care and decision support systems and their ability to reach an equivalent fluid balance. As mentioned before, any tool with the ability to perform successfully while keeping high standards of care must be considered potentially useful, since it may allow dedicating human resources to more sophisticated tasks in healthcare.
Finally, the degree of acceptance of systems that report high levels of acceptance was evaluated for these systems for treatment and diagnosis [60,62] Other studies have considered it negative in terms of a lack of confidence in the decisions suggested, as occurs in nursing staff, about the regulation of glucose levels by prolonging the time to accept or reject the suggestion, concluding that these tools represent low impact on their work activities [69]. Doubt then arises about whether the correct implementation of CDSSs, despite their initial investment, guarantees a cost reduction at any hospital, as the shorter the patient needs to stay in ICUs, the lower amount of money will be necessary to invest.

5. Conclusions

In this systematic review, CDSSs were proven to be a useful tool, especially in the three categories of reductions in prescription errors, with a near total in certain types of error reduction, the prediction of evolution and prognosis, with a higher capacity than the scales commonly used to predict readmission and even an in-mortality reduction in the context of infant heart surgery, and in the of costs reduction, by reducing stay times and complications.
In the other categories, i.e., the standardization of protocols, adjustment with a target, warning systems, and acceptance, the results were less consistent and sometimes contradictory. Clarification will have to wait for new systems to be developed, so that their usefulness in ICUs can be assessed.

Supplementary Materials

The following are available online at https://www.mdpi.com/2076-3417/11/6/2880/s1, File S1: Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist; Table S1: Search strategies from each database.

Author Contributions

The authors contributed to this research article in the following ways: conceptualization, M.P., P.C.-M., and J.P.; methodology, M.P. and P.C.-M.; formal analysis, M.P., P.C.-M., A.L.-Á., and J.P.; investigation, M.P., P.C.-M., A.L.-Á., and J.P.; writing—original draft preparation, M.P., P.C.-M., and A.L.-Á.; writing—review and editing: G.B., A.P., and J.P.; visualization and supervision, all authors; funding acquisition, P.C.-M. All authors read and agreed to the published version of the manuscript.

Funding

The authors disclose the receipt of the following financial support for the research, authorship, and/or publication of this article: all of the economic costs involved in the study were borne by the research team. This work was supported in part by grants from the European Social Fund 2014–2020. The Research Centre of the Galician University System (CITIC) and the Galician University System (SUG) obtained funds through the Regional Development Fund (ERDF), with 80% from the Operational Program ERDF Galicia 2014–2020 and the remaining 20% from the Secretaría Xeral de Universidades of the Galician University System (SUG). P.C.-M. obtained a scholarship (Ref. ED481A-2019/069) to develop a Ph.D. thesis. Furthermore, the diffusion and publication of this research were funded by the CITIC as a Research Centre by Galician University System with the support previously mentioned (Ref. ED431G-2019/01). In addition, this work was also funded by a grant for the consolidation and structuring of competitive research units (ED431C 2018/49) from the General Directorate of Culture, Education and University Management of Xunta de Galicia, and the CYTED.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The study’s data are available to any researcher who contacts the corresponding author, Patricia Concheiro-Moscoso ([email protected]).

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Search Terms

KeywordsMesh Terms
Intensive Care UnitsIntensive Care Units (Coronary Care Units; Intensive Care Units, Pediatric; Intensive Care Units, Neonatal)
Critical CareCritical Care (Early Goal-Directed Therapy; Intensive Care)
Artificial IntelligenceArtificial intelligence (Computer Heuristics; Expert Systems; Fuzzy Logic; Knowledge Bases; Machine Learning)
Big DataBig Data
Electronic Medical RecordsElectronic Health Records (Health Information Exchange)
Clinical Decision Support SystemsDecision Support Systems, Clinical
Computerized Physician Order EntryMedical Order Entry Systems
DatabaseDatabase Management Systems
Cardiogenic ShockShock, Cardiogenic
Post-CardiacPost-Cardiac Arrest Syndrome

References

  1. Elgharably, H.; Gamaleldin, M.; Ayyat, K.S.; Zaki, A.; Hodges, K.; Kindzelski, B.; Yongue, C.; de la Serna, S.; Perez, J.; Spencer, C.; et al. Serious Gastrointestinal Complications after Cardiac Surgery & Associated Mortality. Ann. Thorac. Surg. 2020. [Google Scholar] [CrossRef]
  2. Tanner, T.G.; Colvin, M.O. Pulmonary Complications of Cardiac Surgery. Lung 2020, 198, 889–896. [Google Scholar] [CrossRef]
  3. Ghannem, M.; Ahmaidi, S.; Ghannem, L.; Meimoun, P. Infectious and inflammatory complications occurring after cardiac surgery in cardiac rehabilitation centres. Ann. Cardiol. Angeiol. (Paris) 2020, 69, 424–429. [Google Scholar] [CrossRef] [PubMed]
  4. Hassan, A.; Anderson, C.; Kypson, A.; Kindell, L.; Ferguson, T.B.; Chitwood, W.R.; Rodriguez, E. Clinical Outcomes in Patients With Prolonged Intensive Care Unit Length of Stay After Cardiac Surgical Procedures. Ann. Thorac. Surg. 2012, 93, 565–569. [Google Scholar] [CrossRef]
  5. Silberman, S.; Bitran, D.; Fink, D.; Tauber, R.; Merin, O. Very Prolonged Stay in the Intensive Care Unit After Cardiac Operations: Early Results and Late Survival. Ann. Thorac. Surg. 2013, 96, 15–22. [Google Scholar] [CrossRef] [PubMed]
  6. Cho, Y.J.; Nam, K.; Yoo, S.J.; Lee, S.; Bae, J.; Park, J.-Y.; Kim, H.-R.; Kim, T.K.; Jeon, Y. Effects of remote ischemic preconditioning on platelet activation and reactivity in patients undergoing cardiac surgery using cardiopulmonary bypass: A randomized controlled trial. Platelets 2020, 1–9. [Google Scholar] [CrossRef]
  7. Vedel, A.G.; Holmgaard, F.; Rasmussen, L.S.; Langkilde, A.; Paulson, O.B.; Lange, T.; Thomsen, C.; Olsen, P.S.; Ravn, H.B.; Nilsson, J.C. High-target versus low-target blood pressure management during cardiopulmonary bypass to prevent cerebral injury in cardiac surgery patients: A randomized controlled trial. Circulation 2018, 137, 1770–1780. [Google Scholar] [CrossRef]
  8. Abrard, S.; Fouquet, O.; Riou, J.; Rineau, E.; Abraham, P.; Sargentini, C.; Bigou, Y.; Baufreton, C.; Lasocki, S.; Henni, S. Preoperative endothelial dysfunction in cutaneous microcirculation is associated with postoperative organ injury after cardiac surgery using extracorporeal circulation: A prospective cohort study. Ann. Intensive Care 2021, 11, 4. [Google Scholar] [CrossRef]
  9. Rossaint, J.; Berger, C.; Van Aken, H.; Scheld, H.H.; Zahn, P.K.; Rukosujew, A.; Zarbock, A. Cardiopulmonary Bypass during Cardiac Surgery Modulates Systemic Inflammation by Affecting Different Steps of the Leukocyte Recruitment Cascade. PLoS ONE 2012, 7, e45738. [Google Scholar] [CrossRef] [Green Version]
  10. Itagaki, S.; Chikwe, J.P.; Chiang, Y.P.; Egorova, N.N.; Adams, D.H. Long-Term Risk for Aortic Complications After Aortic Valve Replacement in Patients With Bicuspid Aortic Valve Versus Marfan Syndrome. J. Am. Coll. Cardiol. 2015, 65, 2363–2369. [Google Scholar] [CrossRef] [Green Version]
  11. Arora, R.C.; Chatterjee, S.; Shake, J.G.; Hirose, H.; Engelman, D.T.; Rabin, J.; Firstenberg, M.; Moosdorf, R.G.H.; Geller, C.M.; Hiebert, B.; et al. Survey of Contemporary Cardiac Surgery Intensive Care Unit Models in the United States. Ann. Thorac. Surg. 2020, 109, 702–710. [Google Scholar] [CrossRef] [PubMed]
  12. Benoit, M.A.; Bagshaw, S.M.; Norris, C.M.; Zibdawi, M.; Chin, W.D.; Ross, D.B.; Van Diepen, S. Postoperative complications and outcomes associated with a transition to 24/7 intensivist management of cardiac surgery patients. Crit. Care Med. 2017, 45, 993–1000. [Google Scholar] [CrossRef] [PubMed]
  13. Kumar, K.; Zarychanski, R.; Bell, D.D.; Manji, R.; Zivot, J.; Menkis, A.H.; Arora, R.C. Impact of 24-Hour In-House Intensivists on a Dedicated Cardiac Surgery Intensive Care Unit. Ann. Thorac. Surg. 2009, 88, 1153–1161. [Google Scholar] [CrossRef]
  14. Rahmanian, P.B.; Kröner, A.; Langebartels, G.; Özel, O.; Wippermann, J.; Wahlers, T. Impact of major non-cardiac complications on outcome following cardiac surgery procedures: Logistic regression analysis in a very recent patient cohort. Interact. Cardiovasc. Thorac. Surg. 2013, 17, 319–327. [Google Scholar] [CrossRef] [Green Version]
  15. Pimentel, M.F.; Soares, M.J.F.; Junior, J.A.M.; de Oliveira, M.A.B.; Faria, F.L.; Faveri, V.Z.; Iano, Y.; Guido, R.C. Predictive Factors of Long-Term Stay in the ICU after Cardiac Surgery: Logistic CASUS Score, Serum Bilirubin Dosage and Extracorporeal Circulation Time. Braz. J. Cardiovasc. Surg. 2017, 32, 367–371. [Google Scholar] [CrossRef] [Green Version]
  16. Albanesi, B.; Nania, T.; Barello, S.; Villa, G.; Rosa, D.; Caruso, R.; Udugampolage, N.S.; Casole, L.; Dellafiore, F. Lived experience of patients in after cardiac surgery: A phenomenological study. Nurs. Crit. Care 2020. [Google Scholar] [CrossRef]
  17. Kolat, P.; Guttenberger, P.; Ried, M.; Kapahnke, J.; Haneya, A.; Schmid, C.; Diez, C. ICU Readmission after Cardiac Surgery—Still a Matter of Concern? Thorac. Cardiovasc. Surg. 2020, 68, 384–388. [Google Scholar] [CrossRef]
  18. Latif, A.; Kruer, R.; Jarrell, A. Reducing medication errors in critical care: A multimodal approach. Clin. Pharmacol. Adv. Appl. 2014, 6, 117–126. [Google Scholar] [CrossRef] [Green Version]
  19. Martinez, E.A.; Shore, A.; Colantuoni, E.; Herzer, K.; Thompson, D.A.; Gurses, A.P.; Marsteller, J.A.; Bauer, L.; Goeschel, C.A.; Cleary, K.; et al. Cardiac surgery errors: Results from the UK National Reporting and Learning System. Int. J. Qual. Heal. Care 2011, 23, 151–158. [Google Scholar] [CrossRef] [Green Version]
  20. Farzi, S.; Irajpour, A.; Saghaei, M.; Ravaghi, H. Causes of medication errors in intensive care units from the perspective of healthcare professionals. J. Res. Pharm. Pract. 2017, 6, 158–165. [Google Scholar] [CrossRef] [PubMed]
  21. Martínez-Romero, M.; Vázquez-Naya, J.M.; Pereira, J.; Pereira, M.; Pazos, A.; Baños, G. The iOSC3 System: Using Ontologies and SWRL Rules for Intelligent Supervision and Care of Patients with Acute Cardiac Disorders. Comput. Math. Methods Med. 2013, 2013, 650671. [Google Scholar] [CrossRef] [Green Version]
  22. Chi, C.-L.; Street, W.N.; Katz, D.A. A decision support system for cost-effective diagnosis. Artif. Intell. Med. 2010, 50, 149–161. [Google Scholar] [CrossRef]
  23. Kindle, R.D.; Badawi, O.; Celi, L.A.; Sturland, S. Intensive Care Unit Telemedicine in the Era of Big Data, Artificial Intelligence, and Computer Clinical Decision Support Systems. Crit. Care Clin. 2019, 35, 483–495. [Google Scholar] [CrossRef] [PubMed]
  24. Schuh, C.; de Bruin, J.S.; Seeling, W. Clinical decision support systems at the Vienna General Hospital using Arden Syntax: Design, implementation, and integration. Artif. Intell. Med. 2018, 92, 24–33. [Google Scholar] [CrossRef]
  25. Fernandes, M.; Vieira, S.M.; Leite, F.; Palos, C.; Finkelstein, S.; Sousa, J.M.C. Clinical Decision Support Systems for Triage in the Emergency Department using Intelligent Systems: A Review. Artif. Intell. Med. 2020, 102, 101762. [Google Scholar] [CrossRef] [PubMed]
  26. Johnson, A.E.W.; Ghassemi, M.M.; Nemati, S.; Niehaus, K.E.; Clifton, D.; Clifford, G.D. Machine Learning and Decision Support in Critical Care. Proc. IEEE 2016, 104, 444–466. [Google Scholar] [CrossRef] [Green Version]
  27. Sidey-Gibbons, J.A.M.; Sidey-Gibbons, C.J. Machine learning in medicine: A practical introduction. BMC Med. Res. Methodol. 2019, 19, 64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Osheroff, J. Improving Outcomes with Clinical Decision Support; HIMSS Publishing: Boca Ratón, FL, USA, 2012; ISBN 9781498757461. [Google Scholar]
  29. Tygesen, H.; Eriksson, H.; Herlitz, J. Clinical decision support system (CDSS)—Effects on care quality. Int. J. Health Care Qual. Assur. 2014, 27, 707–718. [Google Scholar] [CrossRef] [Green Version]
  30. Fan, Y.; Zhao, Y.; Li, P.; Liu, X.; Jia, L.; Li, K.; Feng, C.; Pan, F.; Li, T.; Zhang, Z.; et al. Analysis of diseases distribution in Medical Information Mart for Intensive Care III database. Zhonghua Wei Zhong Bing Ji Jiu Yi Xue 2018, 30, 531–537. [Google Scholar] [CrossRef]
  31. Celi, L.; Hinske, L.C.; Alterovitz, G.; Szolovits, P. An artificial intelligence tool to predict fluid requirement in the intensive care unit: A proof-of-concept study. Crit. Care 2008, 12, R151. [Google Scholar] [CrossRef] [Green Version]
  32. Bashar, S.K.; Hossain, M.B.; Ding, E.; Walkey, A.J.; McManus, D.D.; Chon, K.H. Atrial Fibrillation Detection During Sepsis: Study on MIMIC III ICU Data. IEEE J. Biomed. Heal. Inform. 2020, 24, 3124–3135. [Google Scholar] [CrossRef] [PubMed]
  33. Lin, C.-P.; Payne, T.H.; Nichol, W.P.; Hoey, P.J.; Anderson, C.L.; Gennari, J.H. Evaluating Clinical Decision Support Systems: Monitoring CPOE Order Check Override Rates in the Department of Veterans Affairs’ Computerized Patient Record System. J. Am. Med. Inform. Assoc. 2008, 15, 620–626. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Wong, A.; Amato, M.G.; Seger, D.L.; Rehr, C.; Wright, A.; Slight, S.P.; Beeler, P.E.; Orav, E.J.; Bates, D.W. Prospective evaluation of medication-related clinical decision support over-rides in the intensive care unit. BMJ Qual. Saf. 2018, 27, 718–724. [Google Scholar] [CrossRef] [Green Version]
  35. Cresswell, K.; Mozaffar, H.; Shah, S.; Sheikh, A. Approaches to promoting the appropriate use of antibiotics through hospital electronic prescribing systems: A scoping review. Int. J. Pharm. Pract. 2017, 25, 5–17. [Google Scholar] [CrossRef] [Green Version]
  36. Stultz, J.S.; Nahata, M.C. Computerized clinical decision support for medication prescribing and utilization in pediatrics. J. Am. Med. Inform. Assoc. 2012, 19, 942–953. [Google Scholar] [CrossRef] [Green Version]
  37. Jin, B.; Che, C.; Liu, Z.; Zhang, S.; Yin, X.; Wei, X. Predicting the Risk of Heart Failure With EHR Sequential Data Modeling. IEEE Access 2018, 6, 9256–9261. [Google Scholar] [CrossRef]
  38. Dias, D.; Paulo Silva Cunha, J. Wearable Health Devices—Vital Sign Monitoring, Systems and Technologies. Sensors 2018, 18, 2414. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Downing, N.L.; Rolnick, J.; Poole, S.F.; Hall, E.; Wessels, A.J.; Heidenreich, P.; Shieh, L. Electronic health record-based clinical decision support alert for severe sepsis: A randomised evaluation. BMJ Qual. Saf. 2019, 28, 762–768. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Prgomet, M.; Li, L.; Niazkhani, Z.; Georgiou, A.; Westbrook, J.I. Impact of commercial computerized provider order entry (CPOE) and clinical decision support systems (CDSSs) on medication errors, length of stay, and mortality in intensive care units: A systematic review and meta-analysis. J. Am. Med. Inform. Assoc. 2017, 24, 413–422. [Google Scholar] [CrossRef] [Green Version]
  41. Vermeulen, K.M.; van Doormaal, J.E.; Zaal, R.J.; Mol, P.G.M.; Lenderink, A.W.; Haaijer-Ruskamp, F.M.; Kosterink, J.G.W.; van den Bemt, P.M.L.A. Cost-effectiveness of an electronic medication ordering system (CPOE/CDSS) in hospitalized patients. Int. J. Med. Inform. 2014, 83, 572–580. [Google Scholar] [CrossRef]
  42. Jacob, V.; Thota, A.B.; Chattopadhyay, S.K.; Njie, G.J.; Proia, K.K.; Hopkins, D.P.; Ross, M.N.; Pronk, N.P.; Clymer, J.M. Cost and economic benefit of clinical decision support systems for cardiovascular disease prevention: A community guide systematic review. J. Am. Med. Inform. Assoc. 2017, 24, 669–676. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Njie, G.J.; Proia, K.K.; Thota, A.B.; Finnie, R.K.C.; Hopkins, D.P.; Banks, S.M.; Callahan, D.B.; Pronk, N.P.; Rask, K.J.; Lackland, D.T.; et al. Clinical Decision Support Systems and Prevention. Am. J. Prev. Med. 2015, 49, 784–795. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Fillmore, C.L.; Bray, B.E.; Kawamoto, K. Systematic review of clinical decision support interventions with potential for inpatient cost reduction. BMC Med. Inform. Decis. Mak. 2013, 13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Ann McKibbon, K.; Lokker, C.; Handler, S.M.; Dolovich, L.R.; Holbrook, A.M.; O’Reilly, D.; Tamblyn, R.; Hemens, B.J.; Basu, R.; Troyan, S.; et al. The effectiveness of integrated health information technologies across the phases of medication management: A systematic review of randomized controlled trials. J. Am. Med. Informatics Assoc. 2012, 19, 22–30. [Google Scholar] [CrossRef] [Green Version]
  46. Sutton, R.T.; Pincock, D.; Baumgart, D.C.; Sadowski, D.C.; Fedorak, R.N.; Kroeker, K.I. An overview of clinical decision support systems: Benefits, risks, and strategies for success. npj Digit. Med. 2020, 3, 17. [Google Scholar] [CrossRef] [Green Version]
  47. Chuo, J.; Hicks, R.W. Computer-Related Medication Errors in Neonatal Intensive Care Units. Clin. Perinatol. 2008, 35, 119–139. [Google Scholar] [CrossRef]
  48. MacK, E.H.; Wheeler, D.S.; Embi, P.J. Clinical decision support systems in the pediatric intensive care unit. Pediatr. Crit. Care Med. 2009, 10, 23–28. [Google Scholar] [CrossRef]
  49. York, J.B.; Cardoso, M.Z.; Azuma, D.S.; Beam, K.S.; Binney, G.G.; Weingart, S.N. Computerized Physician Order Entry in the Neonatal Intensive Care Unit: A Narrative Review. Appl. Clin. Inform. 2019, 10, 487–494. [Google Scholar] [CrossRef] [PubMed]
  50. Moher, D.; Shamseer, L.; Clarke, M.; Ghersi, D.; Liberati, A.; Petticrew, M.; Shekelle, P.; Stewart, L.A. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst. Rev. 2015, 4, 1. [Google Scholar] [CrossRef] [Green Version]
  51. Banner, M.J.; Euliano, N.R.; MacIntyre, N.R.; Layon, A.J.; Bonett, S.; Gentile, M.A.; Bshouty, Z.; Peters, C.; Gabrielli, A. Ventilator Advisory System Employing Load and Tolerance Strategy Recommends Appropriate Pressure Support Ventilation Settings. Chest 2008, 133, 697–703. [Google Scholar] [CrossRef]
  52. Campion, T.R.; May, A.K.; Waitman, L.R.; Ozdas, A.; Lorenzi, N.M.; Gadd, C.S. Characteristics and effects of nurse dosing over-rides on computer-based intensive insulin therapy protocol performance. J. Am. Med. Inform. Assoc. 2011, 18, 251–258. [Google Scholar] [CrossRef] [Green Version]
  53. Denaï, M.A.; Mahfouf, M.; Ross, J.J. A hybrid hierarchical decision support system for cardiac surgical intensive care patients. Part I: Physiological modelling and decision support system design. Artif. Intell. Med. 2009, 45, 35–52. [Google Scholar] [CrossRef] [PubMed]
  54. Hsu, J.-C.; Chen, Y.-F.; Chung, W.-S.; Tan, T.-H.; Chen, T.; Chiang, J.Y. Clinical Verification of A Clinical Decision Support System for Ventilator Weaning. Biomed. Eng. Online 2013, 12, S4. [Google Scholar] [CrossRef] [Green Version]
  55. Jalali, A.; Bender, D.; Rehman, M.; Nadkanri, V.; Nataraj, C. Advanced analytics for outcome prediction in intensive care units. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 2520–2524. [Google Scholar]
  56. Jalali, A.; Simpao, A.F.; Gálvez, J.A.; Licht, D.J.; Nataraj, C. Prediction of Periventricular Leukomalacia in Neonates after Cardiac Surgery Using Machine Learning Algorithms. J. Med. Syst. 2018, 42, 177. [Google Scholar] [CrossRef]
  57. Kallet, R.H.; Branson, R.D. Respiratory controversies in the critical care setting. Do the NIH ARDS Clinical Trials Network PEEP/FIO2 tables provide the best evidence-based guide to balancing PEEP and FIO2 settings in adults? Respir. Care 2007, 52, 461–475; discussion 475–477. [Google Scholar]
  58. May, L.J.; Longhurst, C.A.; Pageler, N.M.; Wood, M.S.; Sharek, P.J.; Zebrack, C.M. Optimizing Care of Adults With Congenital Heart Disease in a Pediatric Cardiovascular ICU Using Electronic Clinical Decision Support. Pediatr. Crit. Care Med. 2014, 15, 428–434. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Ross, J.J.; Denaï, M.A.; Mahfouf, M. A hybrid hierarchical decision support system for cardiac surgical intensive care patients. Part II. Clinical implementation and evaluation. Artif. Intell. Med. 2009, 45, 53–62. [Google Scholar] [CrossRef]
  60. Sintchenko, V.; Coiera, E. Decision complexity affects the extent and type of decision support use. In AMIA Annual Symposium Proceedings; American Medical Informatics Association: Bethesda, MD, USA, 2006; pp. 724–728. [Google Scholar]
  61. Sondergaard, S.; Wall, P.; Cocks, K.; Parkin, W.G.; Leaning, M.S. High concordance between expert anaesthetists’ actions and advice of decision support system in achieving oxygen delivery targets in high-risk surgery patients. Br. J. Anaesth. 2012, 108, 966–972. [Google Scholar] [CrossRef] [Green Version]
  62. Thompson, B.T.; Orme, J.F.; Zheng, H.; Luckett, P.M.; Truwit, J.D.; Willson, D.F.; Hite, R.D.; Brower, R.G.; Bernard, G.R.; Curley, M.A.Q.; et al. Multicenter Validation of a Computer-Based Clinical Decision Support Tool for Glucose Control in Adult and Pediatric Intensive Care Units. J. Diabetes Sci. Technol. 2008, 2, 357–368. [Google Scholar] [CrossRef] [PubMed]
  63. Warrick, C.; Naik, H.; Avis, S.; Fletcher, P.; Franklin, B.D.; Inwald, D. A clinical information system reduces medication errors in paediatric intensive care. Intensive Care Med. 2011, 37, 691–694. [Google Scholar] [CrossRef] [PubMed]
  64. Zaslansky, R.; Rothaug, J.; Chapman, R.C.; Backström, R.; Brill, S.; Engel, C.; Fletcher, D.; Fodor, L.; Funk, P.; Gordon, D.; et al. PAIN OUT: An international acute pain registry supporting clinicians in decision making and in quality improvement activities. J. Eval. Clin. Pract. 2014, 20, 1090–1098. [Google Scholar] [CrossRef]
  65. Aushev, A.; Ripoll, V.R.; Vellido, A.; Aletti, F.; Pinto, B.B.; Herpain, A.; Post, E.H.; Medina, E.R.; Ferrer, R.; Baselli, G.; et al. Feature selection for the accurate prediction of septic and cardiogenic shock ICU mortality in the acute phase. PLoS ONE 2018, 13, e0199089. [Google Scholar] [CrossRef] [Green Version]
  66. Johnson, A.E.W.; Pollard, T.J.; Shen, L.; Lehman, L.H.; Feng, M.; Ghassemi, M.; Moody, B.; Szolovits, P.; Anthony Celi, L.; Mark, R.G. MIMIC-III, a freely accessible critical care database. Sci. Data 2016, 3, 160035. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  67. Saeed, M.; Villarroel, M.; Reisner, A.T.; Clifford, G.; Lehman, L.-W.; Moody, G.; Heldt, T.; Kyaw, T.H.; Moody, B.; Mark, R.G. Multiparameter Intelligent Monitoring in Intensive Care II: A public-access intensive care unit database. Crit. Care Med. 2011, 39, 952–960. [Google Scholar] [CrossRef] [Green Version]
  68. Rojas, J.C.; Carey, K.A.; Edelson, D.P.; Venable, L.R.; Howell, M.D.; Churpek, M.M. Predicting Intensive Care Unit Readmission with Machine Learning Using Electronic Health Record Data. Ann. Am. Thorac. Soc. 2018, 15, 846–853. [Google Scholar] [CrossRef]
  69. Armada, E.R.; Villamañán, E.; López-de-Sá, E.; Rosillo, S.; Rey-Blas, J.R.; Testillano, M.L.; Álvarez-Sala, R.; López-Sendón, J. Computerized physician order entry in the cardiac intensive care unit: Effects on prescription errors and workflow conditions. J. Crit. Care 2014, 29, 188–193. [Google Scholar] [CrossRef] [PubMed]
  70. Gouyon, B.; Iacobelli, S.; Saliba, E.; Quantin, C.; Pignolet, A.; Jacqz-Aigrain, E.; Gouyon, J.B. A Computer Prescribing Order Entry-Clinical Decision Support system designed for neonatal care: Results of the ‘preselected prescription’ concept at the bedside. J. Clin. Pharm. Ther. 2017, 42, 64–68. [Google Scholar] [CrossRef]
  71. Vardi, A.; Efrati, O.; Levin, I.; Matok, I.; Rubinstein, M.; Paret, G.; Barzilay, Z. Prevention of potential errors in resuscitation medications orders by means of a computerised physician order entry in paediatric critical care. Resuscitation 2007, 73, 400–406. [Google Scholar] [CrossRef] [PubMed]
  72. Wulff, A.; Haarbrandt, B.; Tute, E.; Marschollek, M.; Beerbaum, P.; Jack, T. An interoperable clinical decision-support system for early detection of SIRS in pediatric intensive care using openEHR. Artif. Intell. Med. 2018, 89, 10–23. [Google Scholar] [CrossRef]
  73. Khalifa, M.; Magrabi, F.; Gallego, B. Developing a framework for evidence-based grading and assessment of predictive tools for clinical decision support. BMC Med. Inform. Decis. Mak. 2019, 19, 207. [Google Scholar] [CrossRef] [Green Version]
  74. Myssiorek, D.; Ahmed, Y.; Parsikia, A.; Castaldi, M.; McNelis, J. Factors predictive of the development of surgical site infection in thyroidectomy—An analysis of NSQIP database. Int. J. Surg. 2018, 60, 273–278. [Google Scholar] [CrossRef]
  75. Wessler, B.S.; Lai YH, L.; Kramer, W.; Cangelosi, M.; Raman, G.; Lutz, J.S.; Kent, D.M. Clinical Prediction Models for Cardiovascular Disease. Circ. Cardiovasc. Qual. Outcomes 2015, 8, 368–375. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Elshayib, M.; Pawola, L. Computerized provider order entry–related medication errors among hospitalized patients: An integrative review. Health Inform. J. 2020, 26, 2834–2859. [Google Scholar] [CrossRef] [PubMed]
  77. Manias, E.; Kusljic, S.; Wu, A. Interventions to reduce medication errors in adult medical and surgical settings: A systematic review. Ther. Adv. Drug Saf. 2020, 11, 204209862096830. [Google Scholar] [CrossRef]
  78. Kinlay, M.; Zheng, W.Y.; Burke, R.; Juraskova, I.; Moles, R.; Baysari, M. Medication errors related to computerized provider order entry systems in hospitals and how they change over time: A narrative review. Res. Soc. Adm. Pharm. 2020. [Google Scholar] [CrossRef] [PubMed]
  79. Sutherland, A.; Canobbio, M.; Clarke, J.; Randall, M.; Skelland, T.; Weston, E. Incidence and prevalence of intravenous medication errors in the UK: A systematic review. Eur. J. Hosp. Pharm. 2020, 27, 3–8. [Google Scholar] [CrossRef] [Green Version]
  80. Hosseini-Marznaki, Z.; Pouy, S.; Salisu, W.J.; Emami Zeydi, A. Medication errors among Iranian emergency nurses: A systematic review. Epidemiol. Health 2020, 42, e2020030. [Google Scholar] [CrossRef]
Figure 1. Search and selection flow diagram. ICU, intensive care unit.
Figure 1. Search and selection flow diagram. ICU, intensive care unit.
Applsci 11 02880 g001
Table 1. Summary of the data extracted from the 22 selected studies.
Table 1. Summary of the data extracted from the 22 selected studies.
ReferenceCountrySampleEvent IdentifiedAssociated toDescription
TypeNumberCDSSCPOEDatabaseEHRPurpose of the StudyMain Findings
Armada et al., 2014 [69]SpainAdult patients137Cardiogenic shock, acute coronary syndrome, and malignant arrhythmias x This study analyzed the effects of the Computerized Physician Order Entry (CPOE) system in cardiac patients by detecting medication errors and evaluating the use of electronic prescription by health professionals.The results concluded that CPOE was safe in practice and was well received by health professionals, and its use reduced errors in the prescription.
Aushev et al., 2018 [65]USAAdult patients75Cardiogenic shock and septic shock x The aim of the study was to identify clinical features that can predict mortality associated with cardiogenic or septic shock.This study determined that the application of different models for prediction can prognosticate the risk of death in the acute phase of cardiogenic and septic shock.
Banner et al., 2008 [51]USAAdult patients87Respiratory failurex This study aimed to validate the advisory system recommendation, compared to the experienced physician’s decision.The results indicated that there were not significant differences in either system. The advisory system was well evaluated due to its forecasts in settings of pressure support ventilation (PSV).
Campion et al., 2011 [52]USAAdult patients179,452Emergency general surgery, vascular surgery, and cardiac/thoracic surgeryx The objective of this study was to determine the effects and conditions resulting from nurses’ override of clinical decision support system (CDSS) recommendations in ICUs.The study concluded that the nurses accepted among 95% of dosing recommendations. The evaluation of the frequency, direction, and resistance of the intensive insulin therapy (IIT) of the CDSS overrides may be interesting for the health professionals and researchers.
Denaï et al., 2009 [53]United KingdomAdult patients7Impaired cardiac functionx The aim of the study was to develop a CDSS for clinicians’ decision making in post-cardiac surgery patients weaned from cardiopulmonary bypass.The study showed good feasibility for applying CDSS to control the cardiovascular system in post-surgery patient.
Gouyon et al., 2017 [70]FrancePediatric patients760Lower gestational agexx This project evaluated the performance of the CDSS/CPOE combination, using the out-of-range dose rate.The conclusion was that the CDSS/CPOE system was feasible for the prescription of all drugs in ICUs. This system allows for the evaluation and comparison of drugs.
Hsu et al., 2013 [54]JapanAdult patients380Respiratory failurex The objective was to verify the effectiveness of a CDSS to predict and reduce the use of ventilator weaning.This CDSS was effective in the identification of the earliest time of ventilator weaning for a patient to resume and sustain spontaneous breathing.
Jalali et al., 2016 [55]USAAdult patients4000Cardiac surgery and infectionsx The study’s purpose was to develop a CDSS algorithm for predicting the prognostic of patients in ICUs. The conclusions demonstrated that CDSSs can resolve complex situations in ICUs.
Jalali et al., 2018 [56]USAPediatric patients71Periventricular leukomalaciax The aim was to design a classifier adaptable to the patient and incorporated into the experts’ opinion in the classification process.This project collected data from a highly reliable digital instrument with greater frequency, expanding the set of features, pre-classifying patients according to the diagnosis.
Johnson et al., 2016 [66]USAAdult patients38597Coronary disease, cardiac surgery, trauma, and surgical procedure x This study wanted to determine the accessibility of the Medical Information Mart for Intensive Care III (MIMIC-III) database for the scientific community.The study concluded that the MIMIC-III database allowed access to ICU data at an international level, improving the quality of academic and industrial research.
Kallet et al., 2007 [57]CanadaAdult patientsNAPulmonary and cardiac surgeryx This paper reviewed the use of the National Institutes of Health acute respiratory distress syndrome (ARDS) network positive end-expiratory pressure (PEEP)/ inspired oxygen fraction (FIO2) titration tables to the treatment of patients with ARDS.The study determined that the PEEP/FIO2 tables were a good option for the treatment of ARDS.
May et al., 2014 [58]USAAdult patients114Cardiac surgery x This project’s purpose was to determine if CDSSs will facilitate better compliance with project measures and improve healthcare.Through CDSSs, compliance with national surgical quality was improved.
Rojas et al., 2018 [68]USAAdult patients24885Medical, surgical, and coronary care xThe aim was to use an automatic learning technique to derive an ICU readmission model with electronic medical record variables in real time.The study developed and validated readmission prediction modeling of ICUs through a novel machine modeling technique.
Ross et al., 2009 [59]United KingdomAdult patients3Cardiac surgeryx The study determined whether the CDSS process provides clinical decision-making advice to anesthesiologists.CDSSs developed proposed real-time diagnostic and therapeutic advice based on the continuous monitoring of cardiovascular hemodynamic patients.
Saeed et al., 2011 [67]USAAdult patients22,870Cardiac diseases and coronary problems x The study’s purpose was to develop an ICU research database through automated techniques to aggregate high-resolution diagnostic and therapeutic data in ICU adult patients.The study concluded that the MIMIC-II database is a resource that supports decision making.
Sintchenko et al., 2006 [60]AustraliaSpecialists Intensive Care31Nonex The aim was to examine the impact of CDSSs for ICU antibiotic prescribing.The study concluded that CDSSs are an important factor in the process of complex decisions; it supported decision making and the functionality of different tasks.
Sondergaard et al., 2012 [61]SwedenAdult patients24Pancreatic cancer, heart transplants, and intestinal carcinoid diseasesx The study’s purpose was to research the performance of CDSSs in achieving some parameters in patients with major abdominal surgery.The results demonstrated that there was a concordance between the recommend treatments of CDSSs and the treatments of anesthetists.
Thompson et al., 2008 [62]USAAll adult and pediatric patients148Pulmonary, neurological, cardiovascular, gastrointestinal, and multisystem diseasesx The aim was to determine the effectiveness, satisfaction, and acceptance of eProtocol-insulin in ICUs.eProtocol-insulin was generally accepted in ICUs. This study demonstrated that it can be a decision-support tool and a method for use in practices and clinical research.
Vardi et al., 2007 [71]IsraelPediatric patients105Congenital heart diseases, metabolic diseases, multiple traumas, head traumas, respiratory diseases, and sepsisxx The objective was to determine the impact of CDSS/CPOE in the preventions of medical errors in medication resuscitation orders.The project considered that this warning system is a support tool in drug treatment, leading to medical error reductions.
Warrick et al., 2011 [63]United KingdomPediatric patientsNANonex The study wanted to determine the effect of electronic prescribing (EP) on prescribing errors and doses in pediatric ICUs.The study determined that EP increases medication safety in pediatric ICUs.
Wulff et al., 2018 [72]GermanyPediatric patients16Nonex xThe aim was to develop and evaluate an open electronic health record (EHR) for systemic inflammatory response syndrome (SIRS) detection in pediatric ICUs.The study found that the inclusion of an open EHR in a CDSS can bridge the interoperability gap between local infrastructure in said CDSS.
Zaslansky et al., 2014 [64]GermanyAdults patients40,898Painx The aim was to develop and validate a medical registry to measure and identify some aspects regarding pain.This pain-related CDSS provides health professionals with easy access to data on the clinical management of pain, supporting the decision-making process.
Table 2. Summary of the results field of the study.
Table 2. Summary of the results field of the study.
PatientApplication Area
Before admissionForecast and evolutionary prediction
During admissionReduction in medical errors
Alerts, fast detection of alterations, and treatment settings
Achievement of objectives and maintenance in established ranges
After admissionReduction in health costs
Level of satisfaction in health personnel
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Pereira, M.; Concheiro-Moscoso, P.; López-Álvarez, A.; Baños, G.; Pazos, A.; Pereira, J. Applicability of Clinical Decision Support in Management among Patients Undergoing Cardiac Surgery in Intensive Care Unit: A Systematic Review. Appl. Sci. 2021, 11, 2880. https://doi.org/10.3390/app11062880

AMA Style

Pereira M, Concheiro-Moscoso P, López-Álvarez A, Baños G, Pazos A, Pereira J. Applicability of Clinical Decision Support in Management among Patients Undergoing Cardiac Surgery in Intensive Care Unit: A Systematic Review. Applied Sciences. 2021; 11(6):2880. https://doi.org/10.3390/app11062880

Chicago/Turabian Style

Pereira, Miguel, Patricia Concheiro-Moscoso, Alexo López-Álvarez, Gerardo Baños, Alejandro Pazos, and Javier Pereira. 2021. "Applicability of Clinical Decision Support in Management among Patients Undergoing Cardiac Surgery in Intensive Care Unit: A Systematic Review" Applied Sciences 11, no. 6: 2880. https://doi.org/10.3390/app11062880

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop