Provider Perspectives on Sociotechnical Alignment of Intelligent Clinical Decision Support Systems
Abstract
1. Introduction
1.1. Research Gap and Significance
1.2. Research Question
1.3. Theoretical Frameworks
2. Materials and Methods
2.1. Case Study Context
- A clinical data repository with privacy protection,
- Data retrieval and display,
- Document entry with role-based business rules,
- Problem lists, medication lists, reports (including radiology), and health summaries,
- Provider order entry for all clinical services and departments, and
- Clinical decision support with reminders, real-time clinical alert systems, notification systems, order checking, and disease management features.
- Implement the same EHR system as the DOD and the United States Coast Guard. This system is interoperable with community care providers and enables the seamless sharing of Veteran records from active duty and beyond.
- Provide Veterans and clinicians with a complete picture of a patient’s medical history, driving connections between military service and health outcomes through data analytics.
- Offer an improved, more consistent patient scheduling experience at VA medical facilities and community care partners nationwide.
2.2. Data Collection
2.3. Data Analysis
2.4. Open Coding
2.5. Axial Coding
2.6. Selective/Theoretical Coding
2.7. Reliability
2.8. Validation
3. Results
Findings Table
- Provider experiences are the perspectives highlighting the value and obstacles of the ICDSS.
- Clinical utility refers to how well the ICDSS aligns with workflow and improves decision-making.
- Adaptation reflects the factors that influence trust and perceived autonomy of the ICDSS.
4. Discussion
4.1. Workarounds and Workflow Fit
4.2. Professional Autonomy and AI Collaboration
4.3. De-Skilling Concerns
4.4. Junior vs. Senior Provider Adoption Differences
4.5. Explainability as an Antecedent to Trust
4.6. Theoretical Contributions
4.7. UTAUT: Uncertainty as a Mediating Factor
4.8. DOI: Conditional Adopters
4.9. TAM: Professional Identity
4.10. HOT-Fit: Customization
4.11. Significance of Discussion
4.12. Implications for Healthcare Entities
4.13. Limitations
4.14. Future Research
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| AI | Artificial Intelligence |
| CDSS | Clinical Decision Support System |
| CPRS | Computerized Patient Record System |
| DOI | Diffusion of Innovation |
| DSU | Dakota State University |
| EHR | Electronic Health Record |
| GT | Grounded Theory |
| HOT-fit | Human–Organization–Technology fit |
| ICDSS | Intelligent Clinical Decision Support System |
| IRB | Institutional Review Board |
| IS | Information Systems |
| IT | Information Technology |
| NLP | Natural Language Processing |
| TAM | Technology Acceptance Model |
| UTAUT | Unified Theory of Acceptance and Use of Technology |
| VA | Veterans Affairs |
| VAHCS | Veterans Affairs Healthcare System |
| VistA | Veterans Health Information System and Technology Architecture |
References
- Precedence Research. Artificial Intelligence (AI) in Healthcare Market Size Worldwide from 2021 to 2030. Statista. Available online: https://www.statista.com/statistics/1334826/ai-in-healthcare-market-sizeworldwide/ (accessed on 31 October 2023).
- Ramathilagam, A.; Pitchipoo, P. Modeling and Development of Fuzzy Logic-Based Intelligent Decision Support System. Rom. J. Inform. Sci. Technol. 2022, 25, 58–79. [Google Scholar]
- Wan, W.; Xu, J.; Zeng, Q.; Pan, L.; Sun, W. Development and Evaluation of Intelligent Medical Decision Support Systems. Acad. J. Sci. Technol. 2023, 8, 22–25. [Google Scholar] [CrossRef]
- Khan, M.F.; Haider, F.; Al-Hmouz, A.; Mursaleen, M. Development of an Intelligent Decision Support System for Attaining Sustainable Growth within a Life Insurance Company. Mathematics 2021, 9, 1369. [Google Scholar] [CrossRef]
- Tian, S.; Yang, W.; Grange, J.M.L.; Wang, P.; Huang, W.; Ye, Z. Smart healthcare: Making medical care more intelligent. Glob. Health J. 2019, 3, 62–65. [Google Scholar] [CrossRef]
- Petitgand, C.; Motulsky, A.; Denis, J.-L.; Régis, C. Investigating the Barriers to Physician Adoption of an Artificial Intelligence-Based Decision Support System in Emergency Care: An Interpretative Qualitative Study. In Studies in Health Technology and Informatics; IOS Press: Amsterdam, The Netherlands, 2020; Volume 270, pp. 1001–1005. [Google Scholar]
- Jussupow, E.; Spohrer, K.; Heinzl, A.; Link, C. I am; We are-Conceptualizing Professional Identity Threats from Information Technology. In Proceedings of the International Conference on Information Systems, San Francisco, CA, USA, 13–16 December 2018. [Google Scholar]
- Abell, B.; Naicker, S.; Rodwell, D.; Donovan, T.; Tariq, A.; Baysari, M.; Blythe, R.; Parsons, R.; McPhail, S.M. Identifying Barriers and Facilitators to Successful Implementation of Computerized Clinical Decision Support Systems in Hospitals: A Nasss Framework-Informed Scoping Review. Implement. Sci. 2023, 18, 32. [Google Scholar] [CrossRef]
- Dean, T.B.; Seecheran, R.; Badgett, R.G.; Zackula, R.; Symons, J. Perceptions and Attitudes Toward Artificial Intelligence Among Frontline Physicians and Physicians’ Assistants in Kansas: A Cross-Sectional Survey. JAMIA Open 2024, 7, ooae100. [Google Scholar] [CrossRef]
- Pinsky, M.; Dubrawski, A.; Clermont, G. Intelligent Clinical Decision Support. Sensors 2022, 22, 1408. [Google Scholar] [CrossRef]
- Romero-Brufau, S.; Wyatt, K.D.; Boyum, P.; Mickelson, M.; Moore, M.; Cognetta-Rieke, C. A Lesson in Implementation: A Pre-Post Study of Providers’ Experience with Artificial Intelligence-Based Clinical Decision Support. Int. J. Med. Inform. 2020, 137, 104072. [Google Scholar] [CrossRef]
- Vijayakumar, S.; Lee, V.V.; Leong, Q.Y.; Hong, S.J.; Blasiak, A.; Ho, D. Physicians’ Perspectives on AI in Clinical Decision Support Systems: Interview Study of the CURATE.AI Personalized Dose Optimization Platform. JMIR Hum. Factors 2023, 10, e48476. [Google Scholar] [CrossRef]
- Albahar, F.; Abu-Farha, R.K.; Alshogran, O.Y.; Alhamad, H.; Curtis, C.E.; Marriott, J.F. Healthcare Professionals’ Perceptions, Barriers, and Facilitators towards Adopting Computerised Clinical Decision Support Systems in Antimicrobial Stewardship in Jordanian Hospitals. Healthcare 2023, 11, 836. [Google Scholar] [CrossRef]
- Samhammer, D.; Roller, R.; Hummel, P.; Osmanodja, B.; Burchardt, A.; Mayrdorfer, M.; Duettmann, W.; Dabrock, P. Nothing Works Without the Doctor: Physicians’ Perception of Clinical Decision-Making and Artificial Intelligence. Front. Med. 2022, 9, 1016366. [Google Scholar] [CrossRef] [PubMed]
- Romero-Brufau, S.; Wyatt, K.D.; Boyum, P.; Mickelson, M.; Moore, M.; Cognetta-Rieke, C. Implementation of Artificial Intelligence-Based Clinical Decision Support to Reduce Hospital Readmissions at a Regional Hospital. Appl. Clin. Inform. 2020, 11, 570–577. [Google Scholar] [CrossRef]
- Myers, M.D. Qualitative Research in Information Systems. MIS Q. 1997, 21, 241–242. [Google Scholar] [CrossRef]
- Corbin, J.M.; Strauss, A. Grounded theory research: Procedures, canons, and evaluative criteria. Qual. Sociol. 1990, 13, 3–21. [Google Scholar] [CrossRef]
- Glaser, B.G.; Strauss, A.L. The Discovery of Grounded Theory: Strategies for Qualitative Research; Observations (Chicago, Ill.); Aldine: Chicago, IL, USA, 1967; Available online: https://books.google.com/books?id=oUxEAQAAIAAJ (accessed on 29 January 2026).
- Charmaz, K. Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis; Sage Publications: London, UK, 2006. [Google Scholar]
- Qureshi, H.A.; Ünlü, Z. Beyond the Paradigm Conflicts: A Four-Step Coding Instrument for Grounded Theory. Int. J. Qual. Methods 2020, 19, 160940692092818. [Google Scholar] [CrossRef]
- Slightam, C.; Wray, C.; Tisdale, R.L.; Zulman, D.M.; Gray, C. Opportunities to Enhance the Implementation of Veterans Affairs Video-Based Care: Qualitative Perspectives of Providers from Diverse Specialties. J. Med. Internet Res. 2023, 25, e43314. [Google Scholar] [CrossRef]
- Veterans Affairs. Providing Health Care for Veterans. Veterans Health Administration. Available online: https://www.va.gov/health/ (accessed on 8 August 2023).
- Veterans Affairs. Office of Information Technology. History of IT at VA. Available online: https://www.oit.va.gov/about/history.cfm (accessed on 8 August 2023).
- Li, J. A Service-Oriented Approach to Interoperable and Secure Personal Health Record Systems. In 2017 IEEE Symposium on Service-Oriented System Engineering (SOSE); IEEE: Piscataway, NJ, USA, 2017; pp. 38–46. [Google Scholar] [CrossRef]
- Tomcsanyi, K.M.; Tran, K.A.; Bates, J.; Cunningham, F.E.; Silverman, R.; Norris, A.K.; Moore, V.R.; Voora, D. Veterans Health Administration: Implementation of pharmacogenomic clinical decision support with statin medications and the SLCO1B1 gene as an exemplar. Am. J. Health-Syst. Pharm. 2023, 80, 1082–1089. [Google Scholar] [CrossRef]
- U.S Department of Veteran Affairs. Electronic Health Record Modernization: Transforming Health Care for Veterans, Revolutionizing Health Care for All. Fact Sheet. November 2022. Available online: https://digital.va.gov/ehr-modernization/frequently-asked-question/ (accessed on 17 August 2023).
- Miller, D.P., Jr.; Latulipe, C.; Melius, K.A.; Quandt, S.A.; Arcury, T.A. Primary Care Providers’ Views of Patient Portals: Interview Study of Perceived Benefits and Consequences. J. Med. Internet Res. 2016, 18, e8. [Google Scholar] [CrossRef]
- Charmaz, K. Grounded Theory in the 21st Century: A Qualitative Method for Advancing Social Justice Research. In The Sage Handbook of Qualitative Research; Sage Publications Ltd.: London, UK, 2005; Volume 3, pp. 507–535. [Google Scholar]
- O’Reilly, K.; Paper, D.; Marx, S. Demystifying Grounded Theory for Business Research. Organ. Res. Methods 2012, 15, 247–262. [Google Scholar] [CrossRef]
- Glaser, B.G.; Strauss, A.L. The Discovery of Grounded Theory: Strategies for Qualitative Research, 1st ed.; Routledge: Abingdon, UK, 2017. [Google Scholar] [CrossRef]
- Boudreau, M.-C.; Robey, D. Enacting Integrated Information Technology: A Human Agency Perspective. Organ. Sci. 2005, 16, 3–18. [Google Scholar] [CrossRef]
- Gibbert, M.; Filippetti, V.; Ruigrok, W. What passes as a rigorous case study? Strateg. Manag. J. 2008, 29, 22. [Google Scholar]
- Yin, R.K. Case Study Research: Design and Methods (Applied Social Research Methods); SAGE: Los Angeles, CA, USA, 1994. [Google Scholar]
- Cook, T.D.; Campbell, D.T. Quasi-Experimentation: Design & Analysis Issues for Field Settings; Houghton Mifflin: Boston, MA, USA, 1979. [Google Scholar]
- Wang, L.; Zhang, Z.; Wang, D.; Cao, W.; Zhou, X.; Zhang, P.; Liu, J.; Fan, X.; Tian, F. Human-Centered Design and Evaluation of AI-Empowered Clinical Decision Support Systems: A Systematic Review. Front. Comput. Sci. 2023, 5, 1187299. [Google Scholar] [CrossRef]
- Wang, S.; Xu, J.; Tahmasebi, A.; Daniels, K.; Liu, J.B.; Curry, J.; Cottrill, E.; Lyshchik, A.; Eisenbrey, J.R. Incorporation of a Machine Learning Algorithm with Object Detection Within the Thyroid Imaging Reporting and Data System Improves the Diagnosis of Genetic Risk. Front. Oncol. 2020, 10, 591846. [Google Scholar] [CrossRef]
- Qassim, S.; Golden, G.; Slowey, D.; Sarfas, M.; Whitmore, K.; Perez, T.; Strong, E.; Lundrigan, E.; Fradette, M.-J.; Baxter, J. A mixed-methods feasibility study of a novel AI-enabled, web-based, clinical decision support system for the treatment of major depression in adults. J. Affect. Disord. Rep. 2023, 14, 100677. [Google Scholar] [CrossRef]
- Knop, M.; Weber, S.; Mueller, M.; Niehaves, B. Human Factors and Technological Characteristics Influencing the Interaction of Medical Professionals with Artificial Intelligence–Enabled Clinical Decision Support Systems: Literature Review. JMIR Hum. Factors 2022, 9, e28639. [Google Scholar] [CrossRef]
- Markus, A.F.; Kors, J.A.; Rijnbeek, P.R. The Role of Explainability in Creating Trustworthy Artificial Intelligence for Health Care: A Comprehensive Survey of the Terminology, Design Choices, and Evaluation Strategies. J. Biomed. Inform. 2021, 113, 103655. [Google Scholar] [CrossRef]
- Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User Acceptance of Information Technology: Toward a Unified View. MIS Q. 2003, 27, 425–478. [Google Scholar] [CrossRef]
- Rogers, E.M. Diffusion of Innovations, 5th ed.; Free Press: London, UK; Collier Macmillan: New York, NY, USA, 2003. [Google Scholar]
- Davis, F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef]
- Yusof, M.M.; Kuljis, J.; Papazafeiropoulou, A.; Stergioulas, L.K. An evaluation framework for Health Information Systems: Human, organization and technology-fit factors (HOT-fit). Int. J. Med. Inform. 2008, 77, 386–398. [Google Scholar] [CrossRef] [PubMed]
- Wang, D.; Wang, L.; Zhang, Z.; Wang, D.; Zhu, H.; Gao, Y.; Fan, X.; Tian, F. ‘Brilliant AI Doctor’ in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System Deployment. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems; ACM: New York, NY, USA, 2021; pp. 1–18. [Google Scholar] [CrossRef]
- Jauk, S.; Kramer, D.; Avian, A.; Berghold, A.; Leodolter, W.; Schulz, S. Technology Acceptance of a Machine Learning Algorithm Predicting Delirium in a Clinical Setting: A Mixed-Methods Study. J. Med. Syst. 2021, 45, 48. [Google Scholar] [CrossRef]
- Xie, Y.; Chen, M.; Kao, D.; Gao, G.; Chen, X.A. CheXplain: Enabling Physicians to Explore and Understand Data-Driven, AI-Enabled Medical Imaging Analysis. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems; ACM: New York, NY, USA, 2020; pp. 1–13. [Google Scholar] [CrossRef]


| Category | Concept | Open Codes |
|---|---|---|
| Provider Experience Drivers | Facilitates Medical Information Search | Easily accessible patient information, guided by indication or bacteria type, relevant text groupings on a single screen |
| Improves Task Efficiency | Auto-fill my documentation, just guides me through it, minimize text input, saves me time | |
| Leverages Data-Driven Intelligence | Data helps with decision-making, historical patient data is valuable, value in knowing their service connection | |
| Provides Transparent and Reliable Recommendations | Provide inline resources for calculations, recommendations and guidelines are explained and evidence-based, update transparency | |
| Clinical Utility Drivers | Improves Treatment Choices | Antibiotic alternatives available, certain antibiotics have restrictions, decision support for antibiotic use, decrease usage of unnecessary antibiotics, helps educate patients, manual order approval, order approval automated through CDSS, patient is most important |
| Reduces Adverse Events | Alerts for drug interactions, auto population, choose the right antibiotic the first time, free text input for order adjustments, reminders help me so I do not forget | |
| Supports Diagnosis Process | Assures me, continuous learning, helps me make my clinical decision, include diagnostic support | |
| Adaptation Drivers | Promotes Personalized Training | Hands-on learner, learning by observation, orientation, training maintains consistency, tutored right at your elbow |
| Promotes Team Dialog | Advice maintained in house, advocated by pharmacy, pharmacy supports other providers, provider feedback encouraged, provider mentorship | |
| Improves Technical Literacy | Make most of your tools, technical proficiency varies by provider | |
| Provider Experience Obstacles | Contributes to Cognitive Overload | Hard to navigate, information is hard to find, information overload, technical limitations, the extra clicks are inefficient |
| Data Quality Issues | Documentation is not always right, lack of interoperability, problem list is not always updated, workarounds for limited functionality | |
| Lacks Flexibility | Adjustable user interface, customizable order sets, unable to favorite order sets | |
| Clinical Utility Obstacles | Dehumanizes Patient–Provider Interaction | Internet facilitates patient questioning, patient first documentation second, technology can be impersonable |
| Diminishes Provider Autonomy | Day of the specialization, knowledge is irreplaceable, physicians’ status is diminishing | |
| Increases Workload Through Compliance Requirements | Regulations create additional workload burden | |
| Misaligned with Workflow | Alert fatigue, alerts not contextually relevant, interrupts my thought process using tools outside EHR, mobile app lacks ordering functionality | |
| Adaptation Obstacles | AI Anxiety | AI is helpful, fear of AI automation, natural language processing is not always accurate, natural language processing used for documentation |
| Challenging to Learn | Effectiveness increases with familiarity, make most of your tools | |
| Skepticism | Change is hard, do not make more work for me, effectiveness increases with familiarity, have a backup plan for when technology fails, technology changes fast |
| Thematic Finding | Theoretical Connection | Perspective Category | Extant Literature |
|---|---|---|---|
| Uncertainty | UTAUT | Obstacle: Lack of transparency undermines trust | [38,44] |
| Conditional Adopters | DOI | Obstacle: Perceived loss of decision-making control | [35,44] |
| Professional Identity | TAM | Obstacle: Resistance due to overconfidence | [38] |
| Workflow Fit | HOT-Fit | Obstacle: ICDSS misalignment with provider workflows | [44,45] |
| Driver: Customizable interfaces improve efficiency | [44] |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Behrens, A.; Noteboom, C.; Brooks, P. Provider Perspectives on Sociotechnical Alignment of Intelligent Clinical Decision Support Systems. Information 2026, 17, 191. https://doi.org/10.3390/info17020191
Behrens A, Noteboom C, Brooks P. Provider Perspectives on Sociotechnical Alignment of Intelligent Clinical Decision Support Systems. Information. 2026; 17(2):191. https://doi.org/10.3390/info17020191
Chicago/Turabian StyleBehrens, Andy, Cherie Noteboom, and Patti Brooks. 2026. "Provider Perspectives on Sociotechnical Alignment of Intelligent Clinical Decision Support Systems" Information 17, no. 2: 191. https://doi.org/10.3390/info17020191
APA StyleBehrens, A., Noteboom, C., & Brooks, P. (2026). Provider Perspectives on Sociotechnical Alignment of Intelligent Clinical Decision Support Systems. Information, 17(2), 191. https://doi.org/10.3390/info17020191

