Artificial Intelligence for Identifying the Prevention of Medication Incidents Causing Serious or Moderate Harm: An Analysis Using Incident Reporters’ Views
Abstract
:1. Introduction
2. Materials and Methods
2.1. Design and Setting
2.2. Data
2.3. Data Analysis
2.4. Ethics
3. Results
3.1. Prevention of Serious Medication Incidents
3.1.1. Treatment
3.1.2. Working
3.1.3. Practices
3.1.4. Setting
3.2. Most Important Areas for Risk Management of Medication Incidents
- (1)
- Verification, documentation and up-to-date drug doses, drug lists and other medication information;
- (2)
- Carefulness and accuracy in managing medications;
- (3)
- Ensuring the flow of information and communication regarding medication information and safeguarding continuity of patient care;
- (4)
- Availability, updations, and compliance with instructions and guidelines;
- (5)
- Multi-professional cooperation;
- (6)
- Adequate human resources, competence, and suitable workload.
4. Discussion
Strengths and Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Schachter, M. The epidemiology of medication errors: How many, how serious? Br. J. Clin. Pharmacol. 2009, 67, 621–623. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- NCCMERP. The National Coordinating Council for Medication Error Reporting and Prevention. Medication Errors—Definition. Available online: https://www.nccmerp.org/about-medication-errors (accessed on 26 June 2021).
- Elliott, R.; Camacho, E.; Campbell, F.; Jankovic, D.; St James, M.M.; Kaltenthaler, E.; Wong, R.; Sculpher, M.; Faria, R. Prevalence and Economic Burden of Medication Errors in The NHS in England. Rapid Evidence Synthesis and Economic Analysis of the Prevalence and Burden of Medication Error in the UK. Policy Research Unit in Economic Evaluation of Health and Care Interventions. Universities of Sheffield and York. Available online: http://www.eepru.org.uk/wp-content/uploads/2020/03/medication-error-report-edited-27032020.pdf (accessed on 20 June 2021).
- WHO. Medication without Harm: WHO’s Third Global Patient Safety Challenge. Available online: https://www.who.int/initiatives/medication-without-harm (accessed on 20 June 2021).
- Hewitt, J.; Tower, M.; Latimer, S. An education intervention to improve nursing students’ understanding of medication safety. Nurse Educ. Pract. 2015, 15, 17–21. [Google Scholar] [CrossRef] [PubMed]
- Härkänen, M.; Saano, S.; Vehviläinen-Julkunen, K. Using incident reports to inform the prevention of medication administration errors. J. Clin. Nurs. 2017, 26, 3486–3499. [Google Scholar] [CrossRef]
- Verma, A.; Maiti, J. Text-document clustering-based cause and effect analysis methodology for steel plant incident data. Int. J. Inj. Contr. Saf. Promot. 2018, 25, 416–426. [Google Scholar] [CrossRef] [PubMed]
- Härkänen, M.; Vehviläinen-Julkunen, K.; Murrells, T.; Paananen, J.; Franklin, B.D.; Rafferty, A.M. The Contribution of staffing to medication administration errors: A text mining analysis of incident report data. J. Nurs. Scholarsh. 2020, 52, 113–123. [Google Scholar] [CrossRef]
- Pivovarov, R.; Elhadad, N. Automated methods for the summarization of electronic health records. J. Am. Med. Inform. Assoc. 2015, 22, 938–947. [Google Scholar] [CrossRef] [Green Version]
- Turing, A.M. Computing machinery and intelligence. In Parsing the Turing Test; Springer: Dordrecht, The Netherlands, 2009; pp. 23–65. [Google Scholar]
- Buchanan, B.G. A (very) brief history of artificial intelligence. Ai Mag. 2005, 26, 53. [Google Scholar]
- Azzi, S.; Gagnon, S.; Ramirez, A.; Richards, G. Healthcare applications of artificial intelligence and analytics: A review and proposed framework. Appl. Sci. 2020, 10, 6553. [Google Scholar] [CrossRef]
- Darcy, A.M.; Louie, A.K.; Roberts, L.W. Machine learning and the profession of medicine. JAMA 2016, 315, 551–552. [Google Scholar] [CrossRef] [PubMed]
- Murff, H.J.; Fitzhenry, F.; Matheny, M.E.; Gentry, N.; Kotter, K.L.; Crimin, K.; Speroff, T.; Dittus, R.S.; Rosen, A.K.; Elkin, P.L.; et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA 2011, 306, 848–855. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Härkänen, M.; Paananen, J.; Murrells, T.; Rafferty, A.M.; Franklin, B.D. Identifying risks areas related to medication administrations—Text mining analysis using free-text descriptions of incident reports. BMC Health Serv. Res. 2019, 19, 791. [Google Scholar] [CrossRef]
- Kreimeyer, K.; Foster, M.; Pandey, A.; Arya, N.; Halford, G.; Jones, S.F.; Forshee, R.; Walderhaug, M.; Botsis, T. Natural language processing systems for capturing and standardizing unstructured clinical information: A systematic review. J. Biomed. Inform. 2017, 73, 14–29. [Google Scholar] [CrossRef] [PubMed]
- Young, I.J.B.; Luz, S.; Lone, N. A systematic review of natural language processing for classification tasks in the field of incident reporting and adverse event analysis. Int. J. Med. Inform. 2019, 132, 103971. [Google Scholar] [CrossRef] [PubMed]
- Haipro. Reporting System for Safety Incidents in Health Care Organizations. Available online: http://awanic.com/haipro/eng/ (accessed on 20 June 2021).
- Aiwo. Available online: https://aiwo.ai/aiwosystem/ (accessed on 24 June 2021).
- TENK. The Ethical Principles of Research with Human Participants and Ethical Review in the Human Sciences in Finland. Finnish National Board on Research Integrity TENK Guidelines. Available online: https://www.tenk.fi/sites/tenk.fi/files/Ihmistieteiden_eettisen_ennakkoarvioinnin_ohje_2019.pdf (accessed on 20 June 2021).
- Walsh, K.E.; Landrigan, C.P.; Adams, W.G.; Vinci, R.J.; Chessare, J.B.; Cooper, M.R.; Hebert, P.M.; Schainker, E.G.; McLaughlin, T.J.; Bauchner, H. Effect of computer order entry on prevention of serious medication errors in hospitalized children. Pediatrics 2008, 121, e421–e427. [Google Scholar] [CrossRef]
- Koppel, R.; Metlay, J.P.; Cohen, A.; Abaluck, B.; Localio, A.R.; Kimmel, S.E.; Strom, B.L. Role of computerized physician order entry systems in facilitating medication errors. JAMA 2005, 293, 1197–1203. [Google Scholar] [CrossRef]
- Wang, J.K.; Herzog, N.S.; Kaushal, R.; Park, C.; Mochizuki, C.; Weingarten, S.R. Prevention of pediatric medication errors by hospital pharmacists and the potential benefit of computerized physician order entry. Pediatrics 2007, 119, e77–e85. [Google Scholar] [CrossRef]
- Metsämuuronen, R.; Kokki, H.; Naaranlahti, T.; Kurttila, M.; Heikkilä, R. Nurses’ perceptions of automated dispensing cabinets—An observational study and an online survey. BMC Nurs. 2020, 19, 27. [Google Scholar] [CrossRef] [Green Version]
- Karttunen, M.; Sneck, S.; Jokelainen, J.; Elo, S. Nurses’ self-assessments of adherence to guidelines on safe medication preparation and administration in long-term elderly care. Scand. J. Caring Sci. 2020, 34, 108–117. [Google Scholar] [CrossRef]
- Kim, J.; Bates, D.W. Medication administration errors by nurses: Adherence to guidelines. J. Clin. Nurs. 2013, 22, 590–598. [Google Scholar] [CrossRef] [PubMed]
- Westbrook, J.I.; Rob, M.I.; Woods, A.; Parry, D. Errors in the administration of intravenous medications in hospital and the role of correct procedures and nurse experience. BMJ Qual. Saf. 2011, 20, 1027–1034. [Google Scholar] [CrossRef] [Green Version]
- Rothschild, J.M.; Keohane, C.A.; Cook, E.F.; Orav, E.J.; Burdick, E.; Thompson, S.; Bates, D.W. A controlled trial of smart infusion pumps to improve medication safety in critically ill patients. Crit. Care Med. 2005, 33, 533–540. [Google Scholar] [CrossRef]
- Liang, C.; Gong, Y. Automated classification of multi-labeled patient safety reports: A shift from quantity to quality measure. Stud. Health Technol. Inform. 2017, 245, 1070–1074. [Google Scholar]
- Vrbnjak, D.; Denieffe, S.; O’Gorman, C.; Pajnkihar, M. Barriers to reporting medication errors and near misses among nurses: A systematic review. Int. J. Nurs. Stud. 2016, 63, 162–178. [Google Scholar] [CrossRef] [PubMed]
- NHS England. Improving Medication Error Incident Reporting and Learning. Available online: https://www.england.nhs.uk/wp-content/uploads/2014/03/psa-sup-info-med-error.pdf (accessed on 22 June 2021).
- NHS Improvement. NRLS Official Statistics Publications: Data Quality Statement. NHS Improvement, London. Available online: https://www.england.nhs.uk/wp-content/uploads/2020/09/NRLS-data-quality-statement-march-2018.pdf (accessed on 24 June 2021).
- Härkänen, M.; Vehviläinen-Julkunen, K.; Franklin, B.D.; Murrells, T.; Rafferty, A.M. Factors related to medication administration incidents in England and Wales between 2007 and 2016: A retrospective trend analysis. J. Patient Saf. 2020. [Google Scholar] [CrossRef]
- Botsis, T.; Nguyen, M.D.; Woo, E.J.; Markatou, M.; Ball, R. Text mining for the Vaccine Adverse Event Reporting System: Medical text classification using informative feature selection. J. Am. Med. Inform. Assoc. 2011, 18, 631–638. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Haerian, K.; Varn, D.; Vaidya, S.; Ena, L.; Chase, H.S.; Friedman, C. Detection of pharmacovigilance-related adverse events using electronic health records and automated methods. Clin. Pharmacol. Ther. 2012, 92, 228–234. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Type of Harm | % | Frequency |
---|---|---|
No harm | 49.8% | 1742 |
Mild harm | 18.4% | 642 |
Moderate harm * | 3.6 % | 126 |
Serious harm * | 0.3% | 11 |
Not known | 27.9% | 975 |
Total | 100 | 3496 |
Treatment: - Drugs - Medication - Infusions and hydration - Operations - List of medicines | Working: - Carefulness - Nurses - Physicians - Time schedules - Changes |
Practices: - Guidelines - Prescriptions and recommendations - Documenting - Data management and protection - Flow of information and communication | Setting: - Recovery room - Machines - Data processing systems: “Miranda, Oberon, Pegasos ja Clinisoft” - Stocks and cabinets |
Sub-Categories | Most Common Shared Themes with Other Categories | Example of the Free Text-Description of Incident (Date of the Incident) |
---|---|---|
Drugs (n = 39) | - Working: Physicians (n = 11) - Practices: Guidelines (n = 7) - Working: Carefulness (n = 7) - Practices: Prescriptions and recommendations (n = 7) - Working: Nurses (n = 6) - Treatment: Medication (n = 5) - Working: Changes (n = 4) - Treatment: Operations (n = 3) - Practices: Documenting (n = 3) - Working: Emergency (n = 3) | ‘Any drug, especially for opioids, should be carried out by careful verification of the strengths of the drug with such care whenever the drug is administered that such a serious drug error would not occur. The drug’s dosage package has a really clearly expressed strength of the drug, so it has been entirely about the serious thought error of the midwife who gave the drug.’ (12 September 2017) |
Medication (n = 11) | - Treatment: Drugs (n = 5) - Working: Physicians (n = 2) - Working: Carefulness (n = 2) - Treatment: List of medicines (n = 2) - Practices: Prescriptions and recommendations (n = 2) - Practices: Documenting (n = 2) | ‘The physician should record the medications they prescribe, so the correctness of the order would be ensured... At the same time, the doctor would also notice allergies and interactions.’ (5 July 2019) |
Infusions and hydration (n = 5) | - Practices: Flow of information and communication (n = 2) - Treatment: Drugs (n = 2) - Treatment: Operations (n = 1) - Treatments: Anaesthesia (n = 1) - Practices: Meetings (n = 1) - Practices: Trainings (n = 1) - Practices: Data management and protection (n = 1) - Setting: Recovery room (n = 1) - Setting: Machines (n = 1) - Working: Time schedules (n = 1) - Setting: Outpatient clinic (n = 1) - Working: Nurses (n = 1) | ‘In the middle of the rush, attention to the patient is important and check the infusion pathways that the drug really goes where it should be.’ (14 December 2019) |
Operations (n = 5) | - Treatment: Drugs (n = 3) - Treatment: Anaesthesia (n = 2) - Working: Nurses (n = 2) - Practices: Trainings (n = 1) - Practices: Flow of information and communication (n = 1) - Working: Physicians (n = 1) - Setting: Recovery room (n = 1) - Working: Emergency (n = 1) - Treatment: Infusions and hydration (n = 1) | ‘A checklist for a patient going into surgery should be submitted to the ward.’ (8 May 2019) |
List of medicines (n = 4) | - Working: Carefulness (n = 3) - Treatment: Medication (n = 2) - Working: Physicians (n = 1) - Working: Nurses (n = 1) - Practices: Documenting (n = 1) - Practices: Data management and protection (n = 1) | ‘Timely and carefully reviewing the medical list by physician. Nurse should ask if there are all medications at home.’ (1 September 2018) |
Sub-Categories | Most Common Shared Themes with Other Categories | Example of the Free Text-Description of Incident (Date of the Incident) |
---|---|---|
Carefulness (n = 21) | - Treatment: Drugs (n = 7) - Working: Nurses (n = 4) - Practices: Guidelines (n = 4) - Working: Time schedules (n = 4) - Treatment: List of medicines (n = 3) - Setting: Stocks and cabinets (n = 2) - Working: Physicians (n = 2) - Treatment: Medication (n = 2) - Practices: Documenting (n = 2) | ‘Attention and carefulness in the implementation of prescriptions.’ (24 August 2018) |
Nurses (n = 16) | - Treatment: Drugs (n = 6) - Working: Carefulness (n = 4) - Working: Physicians (n = 3) - Setting: Recovery room (n = 2) - Working: Changes (n = 2) - Treatment: Doses (n = 2) - Treatment: Operations (n = 2) - Practices: Trainings (n = 2) - Practices: Flow of information and communication (n = 2) | ‘Could the incident have been prevented by working as a couple, in which case the inexperienced would “still” have a more ruined nurse with whom to go through daily routines throughout the day and thus ensure that all the work is done.’ (24 July 2019) |
Physicians (n = 12) | - Treatment: Drugs (n = 11) - Practices: Prescriptions and recommendations (n = 5) - Practices: Guidelines (n = 5) - Working: Nurses (n = 3) - Working: Carefulness (n = 2) - Treatment: Medication (n = 2) | ‘Up-to-date administration entries. In the absence of medications, the physician should be informed if there is no replacement’ (2 October 2017) |
Time schedules (n = 5) | - Working: Carefulness (n = 4) - Working: Nurses (n = 1) - Working: Babies and children (n = 1) - Treatment: Drugs (n = 1) - Treatment: Medication (n = 1) - Treatment: Infusions and hydration (n = 1) - Practices: Guidelines (n = 1) | ‘Accuracy for calculating infusion rate, unhurried machine programming.’ (27 June 2019) |
Changes (n = 4) | - Treatment: Drugs (n = 4) - Working: Nurses (n = 2) - Working: Physicians (n = 1) - Practices: Flow of information and communication (n = 1) - Practices: Prescriptions and recommendations (n = 1) | ‘The drug changes were made on Monday afternoon and they were left unnoticed. Changes were left unnoticed over several shifts.’ (7 August 2019) |
Sub-Categories | Most Common Shared Themes with Other Categories | Example of the Free Text-Description of Incident (Date of the Incident) |
---|---|---|
Guidelines (n = 12) | - Treatment: Drugs (n = 7) - Working: Physicians (n = 5) - Working: Carefulness (n = 4) - Practices: Documenting (n = 3) - Treatment: Doses (n = 3) - Setting: Stocks and cabinets (n = 2) - Practices: Prescriptions and recommendations (n = 2) | ‘Equipment should be familiar and there should be clear guidelines for new equipment.’ (16 January 2018) |
Prescriptions and recommendations (n = 9) | - Treatment: Drugs (n = 7) - Working: Physicians (n = 5) - Practices: Guidelines (n = 2) - Treatment: Medication (n = 2) | ‘Regular review of the prescriptions section and responding to them. Especially if the on-call physician has been contacted.’ (26 October 2019) |
Documenting (n = 5) | - Treatment: Drugs (n = 3) - Practices: Guidelines (n = 3) - Treatment: Medication (n = 2) - Working: Carefulness (n = 2) | ‘Carefulness in recording home medication especially when it comes with a clear list of home medications. The patient is not always able to tell when to take any medicine.’ (6 July 2019) |
Data management and protection (n = 5) | - Treatment: Drugs (n = 2) - Treatment: List of medicines (n = 1) - Treatment: Medication (n = 1) - Treatment: Infusions and hydration (n = 1) - Practices: Documenting (n = 1) - Practices: Practices and policies (n = 1) - Practices: Meetings (n = 1) - Practices: Guidelines (n = 1) - Practices: Orientation (n = 1) - Practices: Patient record (n = 1) - Practices: Flow of information and communication (n = 1) - Working: Carefulness (n = 1) - Setting: Outpatient clinic (n = 1) | ‘There needs to be a mark of how chemotherapy is dripping, how much medicine is left. Now you can’t find information about this even half night, how much fluid went the previous day.’ (8 January 2019) |
Flow of information and communication (n = 4) | - Working: Nurses (n = 2) - Treatment: Drugs (n = 2) - Treatment: Infusions and hydration (n = 2) - Treatment: Operations (n = 1) - Treatment: Anaesthesia (n = 1) - Practices: Meetings (n = 1) - Practices: Training (n = 1) - Practices: Data management and protection (n = 1) - Practices: Prescriptions and recommendations (n = 1) - Setting: Recovery room (n = 1) - Working: Carefulness (n = 1) - Setting: Outpatient clinic (n = 1) - Working: Physicians (n = 1) - Working: Changes (n = 1) | ‘Staff should ask from patient themselves and check from risk information to see if any previous reactions are known in their medical papers.’ (21 June 2017) |
Sub-Categories | Most Common Shared Themes with Other Categories | Example of the Free Text-Description of Incident (Date of the Incident) |
---|---|---|
Recovery room (n = 4) | - Working: Nurses (n = 2) - Working: Babies and children (n = 1) - Treatment: Operations (n = 1) - Treatment: Anaesthesia (n = 1) - Treatment: Medication (n = 1) - Treatment: Infusions and hydration (n = 1) - Practices: Trainings (n = 1) - Practices: Orientation (n = 1) - Practices: Flow of information and communication (n = 1) | ‘Maybe there were too many events at the same time. Simultaneous caring of mother and child in the recovery room is hectic, especially after emergency dissection when the patient does not have epidural anaesthesia. In addition, two students were involved. There should be calmness at work and the ability to focus on just one patient.’ (22 February 2017) |
Machines (n = 2) | - Treatment: Doses (n = 1) - Treatment: Drugs (n = 1) - Treatment: Infusions and hydration (n = 1) - Practices: Documenting (n = 1) - Practices: Guidelines (n = 1) - Practices: Letters (n = 1) | ‘Distrust of newer Space infusion machines was aroused. It’s hard to put a hose on a spiral if it was suspected as a reason. I think the hose was right on the machine.’ (27 March 2019) |
Data processing systems: (Miranda, Oberon, Pegasos ja Clinisoft) (n = 2) | - Treatment: Drugs (n = 2) - Working: Physicians (n = 1) - Treatment: Preparations (n = 1) - Practices: Prescriptions and recommendations (n = 1) | ‘It would be recommended that the doctor document prescriptions in Miranda [data processing system], hand-transfer of entries expose to error events.’ (17 July 2019) |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Härkänen, M.; Haatainen, K.; Vehviläinen-Julkunen, K.; Miettinen, M. Artificial Intelligence for Identifying the Prevention of Medication Incidents Causing Serious or Moderate Harm: An Analysis Using Incident Reporters’ Views. Int. J. Environ. Res. Public Health 2021, 18, 9206. https://doi.org/10.3390/ijerph18179206
Härkänen M, Haatainen K, Vehviläinen-Julkunen K, Miettinen M. Artificial Intelligence for Identifying the Prevention of Medication Incidents Causing Serious or Moderate Harm: An Analysis Using Incident Reporters’ Views. International Journal of Environmental Research and Public Health. 2021; 18(17):9206. https://doi.org/10.3390/ijerph18179206
Chicago/Turabian StyleHärkänen, Marja, Kaisa Haatainen, Katri Vehviläinen-Julkunen, and Merja Miettinen. 2021. "Artificial Intelligence for Identifying the Prevention of Medication Incidents Causing Serious or Moderate Harm: An Analysis Using Incident Reporters’ Views" International Journal of Environmental Research and Public Health 18, no. 17: 9206. https://doi.org/10.3390/ijerph18179206
APA StyleHärkänen, M., Haatainen, K., Vehviläinen-Julkunen, K., & Miettinen, M. (2021). Artificial Intelligence for Identifying the Prevention of Medication Incidents Causing Serious or Moderate Harm: An Analysis Using Incident Reporters’ Views. International Journal of Environmental Research and Public Health, 18(17), 9206. https://doi.org/10.3390/ijerph18179206