Healthcare AI Governance as a Closed-Loop: A Simulation Based Analysis of Human-Centered Experience Engineering
Abstract
1. Introduction
2. Theoretical Background
2.1. From Human-Centered AI to Experience-Based Governance in Healthcare
2.2. Feedback, Adaptation, and Closed-Loop Governance in Socio-Technical Healthcare Systems
2.3. Positioning This Study: HCEE as an Architecture-Level Design Framework
3. Methods
3.1. Scenario Design and Governance Logic
3.2. Variables, Measures, and Trigger–Control Rules
3.3. Simulation Execution and Reproducibility
3.4. Validation Design and Post-Processing
| Validation Purpose | Analytical Focus | Corresponding Evidence or Experiment | What Can Be Inferred |
|---|---|---|---|
| P1 Mechanism Effect | Does experience-driven closed-loop governance actually induce measurable changes in PXI and EXI? | Main scenario comparison across S1 (No-HCEE), S2 (Partial-HCEE), and S3 (Full-HCEE) | Whether differences in governance maturity translate into distinct levels and trajectories of experience indicators |
| P2 Leverage Explanatory Power | Do core levers—AAL, HOI, TR, and IF—contribute meaningfully to explaining system adjustment outcomes? | Trigger–control structure and rule-based intervention logic operationalized in the Full-HCEE condition (S3) | Whether outcome differences can be interpreted as the result of specific adjustment mechanisms, rather than mere performance comparisons |
| P3 Resilience Under Stress | Does the system demonstrate the potential for recovery and re-stabilization following an exogenous shock? | S4 Stress-Test scenario and week-by-week trajectory analysis post-disruption | Whether the Full-HCEE architecture can form an adaptive recovery path after system-level disruption |
| P4 Structural Robustness | Are the core directional findings maintained across variations in seed, learning rate, agent scale, and interaction probability? | Robustness_SeedCheck, Sensitivity_Alpha, Sensitivity_Agents, and Sensitivity_InteractProb experiments | Whether results are robust against specific initial conditions or single-parameter configurations |
4. HCEE-Based Healthcare AI Governance Architecture
4.1. Four-Layer Architecture
4.2. Interlayer Interfaces and Information Flows
| Layer | Primary Input | Primary Output | Core Responsibility | Upward Feedback | Downward Guidance |
|---|---|---|---|---|---|
| Policy Layer | Institutional priorities, strategic goals, escalated governance signals | Governance direction, review criteria, policy priorities | Set normative boundaries and strategic orientation | Receives escalated system-level concerns | Provides high-level principles and policy direction |
| Governance Layer | Policy direction, PXI/EXI summaries, threshold signals | Oversight rules, escalation decisions, adjustment directives | Interpret system state and determine governance response | Synthesizes experience signals for upper-level review | Translates policy into governance rules and thresholds |
| Control Layer | Governance directives, trigger conditions, lever settings | Intervention actions, recalibration decisions, implementation status | Execute operational adjustment through controllable levers | Reports implementation effects and residual issues | Alters operational conditions affecting interactions |
| Experience Layer | AI-enabled service conditions, user interactions, adjusted operating environment | PXI, EXI, experiential signals | Generate experiential outcomes and recurrent signals | Returns lived operational feedback upward | Receives altered service conditions from control decisions |
4.3. Trigger-Control Mechanism and Core Levers
4.4. Scenario-Specific Implementation
5. Results
5.1. Comparative Results Across Governance–Maturity Scenarios
5.2. Shock Response, Recovery, and Re-Stabilization in S4
5.3. Robustness and Sensitivity Validation
6. Discussion
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| HCEE | Human-Centered Experience Engineering |
| PXI | Patient Experience Index |
| EXI | Employee Experience Index |
| TC | Trigger-Control |
| AAL | AI Autonomy Level |
| HOI | Human Oversight Intensity |
| TR | Trust Recalibration |
| IF | Information Flow |
| ABM | Agent-Based Modeling |
| HCAI | Human-Centered Artificial Intelligence |
| AX | AI Transformation |
Appendix A. Detailed Operating Specification of the HCEE-Based Healthcare AI Governance Architecture
Appendix A.1
| Leverage Dimension | Policy Layer | Governance Layer | Control Layer | Experience Layer |
|---|---|---|---|---|
| Information Flows | Defines what categories of experience-related information must be recognized within the governance boundary. | Routes PXI and EXI signals into trigger evaluation, review, and escalation processes. | Returns current implementation status and lever-adjustment outcomes to the upper layers. | Generates patient- and employee-experience signals that initiate upward feedback. |
| Rules and Intervention Criteria | Establishes high-level boundary conditions related to safety, accountability, fairness, and human oversight. | Interprets experience signals through trigger rules, escalation logic, and review criteria. | Translates governance direction into operational lever adjustment, including AAL, HOI, TR, and IF. | Supplies the observed conditions under which intervention criteria become relevant. |
| Authority and Escalation | Retains authority over higher-order constraints and exceptional review conditions. | Determines whether detected deterioration requires oversight review, selective adjustment, or escalation. | Executes permitted interventions and reports residual issues or implementation effects. | Accumulates field-level consequences that may call for further governance attention. |
| Delays and Learning | Reviews persistent system-level concerns and adjusts higher-order priorities when needed. | Interprets repeated warning patterns and incorporates them into subsequent review and learning cycles. | Recalibrates intervention intensity on the basis of repeated signals and prior adjustment outcomes. | Reflects lagged effects of prior interventions in subsequent PXI and EXI trajectories. |
| Thresholds and Buffers | Defines acceptable operating boundaries within which lower-level adjustment may occur. | Interprets sustained decline, cross-domain imbalance, persistence, and stress cues as governance-relevant signals. | Applies threshold-based activation and stabilizing control logic to avoid overreaction to short-term fluctuation. | Generates the underlying variation that is subsequently filtered, interpreted, and fed back into governance. |
Appendix A.2
| Trigger Code | Trigger Condition | Governance Interpretation | Primary Control Direction | Intended System Effect |
|---|---|---|---|---|
| TC-01 | PXI < 70 after smoothing and rolling-window evaluation | Patient-side experience deterioration requiring corrective attention | Increase trust-repair effort and, where necessary, strengthen oversight and information support | Reduce patient-side dissatisfaction and support recovery of service experience |
| TC-02 | EXI < 65 after smoothing and rolling-window evaluation | Employee-side experience deterioration indicating operational strain or coordination burden | Increase oversight intensity and coordination support; adjust autonomy if required | Reduce staff-side strain and support restoration of operational stability |
| TC-03 | |PXI − EXI| > 15 after smoothing and rolling-window evaluation | Cross-domain imbalance between patient and employee experience requiring rebalancing | Strengthen review and information-flow adjustment to rebalance system conditions across domains | Limit divergence between PXI and EXI and improve cross-domain alignment |
| TC-04 | Persistent warning condition over time | Sustained deterioration suggesting structural rather than temporary instability | Escalate intervention intensity and maintain adjustment until the warning condition is moderated | Prevent prolonged instability and support re-stabilization of the operating state |
| TC-05 | Stress cue or disruption-related instability signal | Elevated risk condition requiring broader adaptive response across the closed loop | Reconfigure lever combination as needed across autonomy, oversight, trust repair, and information flow | Support recovery under stress and restore a stable operating trajectory |
References
- Poon, E.G.; Lemak, C.H.; Rojas, J.C.; Guptill, J.; Classen, D. Adoption of artificial intelligence in healthcare: Survey of health system priorities, successes, and challenges. J. Am. Med. Inform. Assoc. 2025, 32, 1093–1100. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hassan, M.; Kushniruk, A.; Borycki, E. Barriers to and facilitators of artificial intelligence adoption in health care: Scoping review. JMIR Hum. Factors 2024, 11, e48633. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Morley, J.; Machado, C.C.; Burr, C.; Cowls, J.; Joshi, I.; Taddeo, M.; Floridi, L. The ethics of AI in health care: A mapping review. Soc. Sci. Med. 2020, 260, 113172. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- World Health Organization. Ethics and Governance of Artificial Intelligence for Health: Guidance on Large Multi-Modal Models; World Health Organization: Geneva, Switzerland, 2024. [Google Scholar]
- Mennella, C.; Maniscalco, U.; De Pietro, G.; Esposito, M. Ethical and regulatory challenges of AI technologies in healthcare: A narrative review. Heliyon 2024, 10, e26297. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ibáñez, J.C.; Olmeda, M.V. Operationalising AI ethics: How are companies bridging the gap between practice and principles? An exploratory study. AI Soc. 2022, 37, 1663–1687. [Google Scholar]
- Hassan, M.; Borycki, E.M.; Kushniruk, A.W. Artificial intelligence governance framework for healthcare. Healthc. Manag. Forum 2025, 38, 125–130. [Google Scholar]
- Hussein, R.; Zink, A.; Ramadan, B.; Howard, F.M.; Hightower, M.; Shah, S.; Beaulieu-Jones, B.K. Advancing healthcare AI governance through a comprehensive maturity model based on systematic review. npj Digit. Med. 2026, 9, 236. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rahimi, A.K.; Pienaar, O.; Ghadimi, M.; Canfell, O.J.; Pole, J.D.; Shrapnel, S.; van der Vegt, A.H.; Sullivan, C. Implementing AI in hospitals to achieve a learning health system: Systematic review of current enablers and barriers. J. Med. Internet Res. 2024, 26, e49655. [Google Scholar] [CrossRef] [Scilit]
- Kim, J.Y.; Hasan, A.; Kueper, J.; Tang, T.; Hayes, C.; Fine, B.; Balu, S.; Sendak, M. Establishing organizational AI governance in healthcare: A case study in Canada. npj Digit. Med. 2025, 8, 522. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Moy, S.; Irannejad, M.; Manning, S.J.; Farahani, M.; Ahmed, Y.; Gao, E.; Prabhune, R.; Lorenz, S.; Mirza, R.; Klinger, C. Patient perspectives on the use of artificial intelligence in health care: A scoping review. J. Patient-Centered Res. Rev. 2024, 11, 51–62. [Google Scholar] [CrossRef] [Scilit]
- Ayorinde, A.; Mensah, D.O.; Walsh, J.; Ghosh, I.; Ibrahim, S.A.; Hogg, J.; Peek, N.; Griffiths, F. Health care professionals’ experience of using AI: Systematic review with narrative synthesis. J. Med. Internet Res. 2024, 26, e55766. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Fazakarley, C.-A.; Breen, M.; Thompson, B.; Leeson, P.; Williamson, V. Beliefs, experiences and concerns of using artificial intelligence in healthcare: A qualitative synthesis. Digit. Health 2024, 10, 20552076241230075. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Li, L.Z.; Yang, P.; Singer, S.J.; Pfeffer, J.; Mathur, M.B.; Shanafelt, T. Nurse burnout and patient safety, satisfaction, and quality of care: A systematic review and meta-analysis. JAMA Netw. Open 2024, 7, e2443059. [Google Scholar] [PubMed]
- van Leersum, C.M.; Maathuis, C. Human centred explainable AI decision-making in healthcare. J. Responsible Technol. 2025, 21, 100108. [Google Scholar] [CrossRef] [Scilit]
- Wells, B.J.; Nguyen, H.M.; McWilliams, A.; Pallini, M.; Bovi, A.; Kuzma, A.; Kramer, J.; Chou, S.-H.; Hetherington, T.; Corn, P.; et al. A practical framework for appropriate implementation and review of artificial intelligence (FAIR-AI) in healthcare. npj Digit. Med. 2025, 8, 514. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hwang, G.; Hejazian, S.S.; Vafaei Sadr, A.; Wagner, J.K.; Hao, P.; Vemuri, A.; Kawamura, Y.; Nawab, K.; Hijjawi, S.; Zand, R. Translating AI to the Bedside with Physician Buy-In: Recommendations from a Meta-Analysis and Systematic Review of the Literature. Bioengineering 2025, 12, 1363. [Google Scholar] [PubMed]
- Katonai, G.; Arvai, N.; Mesko, B. AI and primary care: Scoping review. J. Med. Internet Res. 2025, 27, e65950. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Nair, M.; Nygren, J.; Nilsen, P.; Gama, F.; Neher, M.; Larsson, I.; Svedberg, P. Critical activities for successful implementation and adoption of AI in healthcare: Towards a process framework for healthcare organizations. Front. Digit. Health 2025, 7, 1550459. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Adnan, H.S.; Shidani, A.; Clifton, L.; Bankhead, C.R.; Perera-Salazar, R. Implementation framework for AI deployment at scale in healthcare systems. iScience 2025, 28, 112406. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chan, A.; Rahimi-Ardabilli, H.; Rogers, W.A.; Coiera, E. The real-world impact of artificial intelligence ethics frameworks across a decade in healthcare: A scoping review. J. Am. Med. Inform. Assoc. 2025, 32, 1767–1777. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Shiferaw, K.B.; Roloff, M.; Balaur, I.; Welter, D.; Waltemath, D.; Zeleke, A.A. Guidelines and standard frameworks for artificial intelligence in medicine: A systematic review. JAMIA Open 2025, 8, ooae155. [Google Scholar] [PubMed]
- Zabala, G.; Pruitt, Z.M.; Fairbanks, R.J.; Ratwani, R. Assessing the Readiness of Health Care Organizations for Safe AI Integration: Perspectives from Quality and Safety Leaders. J. Patient Saf. 2026, 22, 168–172. [Google Scholar] [PubMed]
- Nouis, S.C.; Uren, V.; Jariwala, S. Evaluating accountability, transparency, and bias in AI-assisted healthcare decision-making: A qualitative study of healthcare professionals’ perspectives in the UK. BMC Med. Ethics 2025, 26, 89. [Google Scholar] [PubMed]
- Olawade, D.B.; Weerasinghe, K.; Teke, J.; Msiska, M.; Boussios, S.; Hatzidimitriadou, E. Evaluating AI adoption in healthcare: Insights from the information governance professionals in the United Kingdom. Int. J. Med. Inform. 2025, 199, 105909. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Elgin, C.Y.; Elgin, C. Ethical implications of AI-driven clinical decision support systems on healthcare resource allocation: A qualitative study of healthcare professionals’ perspectives. BMC Med. Ethics 2024, 25, 148. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Osnat, B. Patient perspectives on artificial intelligence in healthcare: A global scoping review of benefits, ethical concerns, and implementation strategies. Int. J. Med. Inform. 2025, 203, 106007. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Foresman, G.; Biro, J.; Tran, A.; MacRae, K.; Kazi, S.; Schubel, L.; Visconti, A.; Gallagher, W.; Smith, K.M.; Giardina, T. Patient perspectives on artificial intelligence in health care: Focus group study for diagnostic communication and tool implementation. J. Particip. Med. 2025, 17, e69564. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tun, H.M.; Rahman, H.A.; Naing, L.; Malik, O.A. Trust in Artificial Intelligence-Based Clinical Decision Support Systems Among Health Care Workers: Systematic Review. J. Med. Internet Res. 2025, 27, e69678. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mikkonen, K.; Tuunainen, S.; Oikarinen, A.; Jansson, M.; Woo, B.; Zhou, W.; Tam, W.; Tuomikoski, A.M.; Kaakinen, P.; Juntunen, J. Artificial Intelligence Technologies Supporting Nurses’ Clinical Decision-Making: A Systematic Review. J. Clin. Nurs. 2026, 35, 1525–1540. [Google Scholar] [PubMed]
- Berger, S.A.; Håland, E.; Solbjør, M. Patient Perspectives on Trust in Artificial Intelligence–Powered Tools in Prostate Cancer Diagnostics. Qual. Health Res. 2025, 36, 276–288. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chandrasekaran, R.; Moustakas, E. Patient attitudes toward ambient artificial intelligence scribes in clinical care: Insights from a cross-sectional study. J. Am. Med. Inform. Assoc. 2026, 33, 263–272. [Google Scholar] [PubMed]
- Lawrence, K.; Kuram, V.S.; Levine, D.L.; Sharif, S.; Polet, C.; Malhotra, K.; Owens, K. Informed Consent for Ambient Documentation Using Generative AI in Ambulatory Care. JAMA Netw. Open 2025, 8, e2522400. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rosenbacke, R.; Melhus, Å.; McKee, M.; Stuckler, D. How explainable artificial intelligence can increase or decrease clinicians’ trust in AI applications in health care: Systematic review. JMIR AI 2024, 3, e53207. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kelly, A.; Bhardwaj, N.; Sainte-Marie, T.T.H.; Van de Ven, P.; Melia, R.; Williams, J.E.; Mathiasen, K.; Nielsen, A.S. Investigating How Clinicians Form Trust in an AI-Based Mental Health Model: Qualitative Case Study. JMIR Hum. Factors 2025, 12, e79658. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Omori, M.; Basnayake, P.; Frazer, H.M.; Keogh, L.; Kunicki, K.; Lippey, J.F. Trust in AI is a “fluid process”: Building trust of AI through clinicians’ needs in the BreastScreen Victoria Program—A qualitative study. Qual. Health Res. 2025, 36, 262–275. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ahmad, O.; Mason, S.; Stanley, S.; Nwosu, A.C. Exploring Perspectives of Health Care Professionals on AI in Palliative Care: Qualitative Interview Study. JMIR Hum. Factors 2025, 12, e79514. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Martínez-Martínez, H.; Martínez-Alfonso, J.; Sánchez-Rojo-Huertas, B.; Reynolds-Cortez, V.; Turégano-Chumillas, A.; Meseguer-Ruiz, V.A.; Cekrezi, S.; Martínez-Vizcaíno, V. Perceptions of, barriers to, and facilitators of the use of AI in primary care: Systematic review of qualitative studies. J. Med. Internet Res. 2025, 27, e71186. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Khan, M.M.; Shah, N.; Shaikh, N.; Thabet, A.; Belkhair, S. Towards secure and trusted AI in healthcare: A systematic review of emerging innovations and ethical challenges. Int. J. Med. Inform. 2025, 195, 105780. [Google Scholar]
- Lekadir, K.; Frangi, A.F.; Porras, A.R.; Glocker, B.; Cintas, C.; Langlotz, C.P.; Weicken, E.; Asselbergs, F.W.; Prior, F.; Collins, G.S. FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare. BMJ 2025, 388, e081554. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Shevtsova, D.; Ahmed, A.; Boot, I.W.; Sanges, C.; Hudecek, M.; Jacobs, J.J.; Hort, S.; Vrijhoef, H.J. Trust in and acceptance of artificial intelligence applications in medicine: Mixed methods study. JMIR Hum. Factors 2024, 11, e47031. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- McCradden, M.D.; Thai, K.; Assadi, A.; Tonekaboni, S.; Stedman, I.; Joshi, S.; Zhang, M.; Chevalier, F.; Goldenberg, A. What makes a ‘good’ decision with artificial intelligence? A grounded theory study in paediatric care. BMJ Evid.-Based. Med. 2025, 30, 183–193. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kim, J.Y.; Hasan, A.; Balu, S.; Sendak, M. People process technology and operations framework for establishing AI governance in healthcare organizations. npj Digit. Med. 2026, 9, 224. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tsoi, A.H.; Gartner, G.; Cotten, S.W.; Kim, J.; Nazarian, J.; Thomas, J.; McSwain, S.D.; Ahmadi-Moosavi, R.; Rimal, R. Establishing and implementing a responsible artificial intelligence framework: A 1-year review. J. Am. Med. Inform. Assoc. 2025, 32, 1778–1784. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Beger, J. Not someone, but something: Rethinking trust in the age of medical AI. Eur. J. Radiol. Artif. Intell. 2025, 3, 100038. [Google Scholar] [CrossRef] [Scilit]
- Maimaitiaili, M.; Jiamaliding, Y.; Dai, G.; Xiao, H.; Kuerbanjiang, W.; Yi, Y. Artificial intelligence platform architecture for hospital systems: Systematic review. J. Med. Internet Res. 2025, 27, e79788. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Patil, S.V.; Myers, C.G.; Dai, T. Protecting clinical value judgment in the age of AI. npj Digit. Med. 2026, 9, 269. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Nong, P.; Maurer, E.; Dwivedi, R. The urgency of centering safety-net organizations in AI governance. npj Digit. Med. 2025, 8, 117. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Jacob, C.; Brasier, N.; Laurenzi, E.; Heuss, S.; Mougiakakou, S.-G.; Cöltekin, A.; Peter, M.K. AI for IMPACTS framework for evaluating the long-term real-world impacts of AI-powered clinician tools: Systematic review and narrative synthesis. J. Med. Internet Res. 2025, 27, e67485. [Google Scholar] [PubMed]
- Stroud, A.M.; Minteer, S.A.; Zhu, X.; Ridgeway, J.L.; Miller, J.E.; Barry, B.A. Patient information needs for transparent and trustworthy cardiovascular artificial intelligence: A qualitative study. PLoS Digit. Health 2025, 4, e0000826. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Alelyani, T. A validated framework for responsible AI in healthcare autonomous systems. Sci. Rep. 2025, 15, 44432. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Templin, T.; Fort, S.; Padmanabham, P.; Seshadri, P.; Rimal, R.; Oliva, J.; Lich, K.H.; Sylvia, S.; Sinnott-Armstrong, N. Framework for bias evaluation in large language models in healthcare settings. npj Digit. Med. 2025, 8, 414. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hong, C.; Chowdhury, A.; Sorrentino, A.D.; Wang, H.; Agrawal, M.; Bedoya, A.; Bessias, S.; Economou-Zavlanos, N.J.; Wong, I.; Pean, C. Application of unified health large language model evaluation framework to In-Basket message replies: Bridging qualitative and quantitative assessments. J. Am. Med. Inform. Assoc. 2025, 32, 626–637. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- You, J.G.; Hernandez-Boussard, T.; Pfeffer, M.A.; Landman, A.; Mishuris, R.G. Clinical trials informed framework for real world clinical implementation and deployment of artificial intelligence applications. npj Digit. Med. 2025, 8, 107. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bouderhem, R. Shaping the future of AI in healthcare through ethics and governance. Humanit. Soc. Sci. Commun. 2024, 11, 416. [Google Scholar] [CrossRef] [Scilit]
- Richter, F.; Holmes, E.; Richter, F.; Guttmann, K.; Duong, S.Q.; Gangadharan, S.; Schadt, E.E.; Salmasian, H.; Gelb, B.D.; Glicksberg, B.S. Toward governance of artificial intelligence in pediatric healthcare. npj Digit. Med. 2025, 8, 636. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Biro, J.; Jabbarpour, Y.; Ratwani, R. A new approach to artificial intelligence safety in primary care. Lancet Prim. Care 2026, 2, 100115. [Google Scholar] [CrossRef] [Scilit]
- Rosenthal, J.T.; Beecy, A.; Sabuncu, M.R. Rethinking clinical trials for medical AI with dynamic deployments of adaptive systems. npj Digit. Med. 2025, 8, 252. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Jackson, N.J.; Brown, K.E.; Miller, R.; Murrow, M.; Cauley, M.R.; Collins, B.X.; Novak, L.L.; Benda, N.C.; Ancker, J.S. Factors influencing the effectiveness of artificial intelligence-assisted decision-making in medicine: A scoping review. J. Am. Med. Inform. Assoc. 2026, 33, 1054–1064. [Google Scholar] [PubMed]
- Saenz, A.D.; McCoy, T.; Mantha, A.B.; Martin, R.; Damiano, R.; Adair, D.; Heaney, D.; Sisodia, R.; Park, L.; Forsberg, R.; et al. Establishing responsible use of AI guidelines: A comprehensive case study for healthcare institutions. npj Digit. Med. 2024, 7, 348. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Solaiman, B.; Mekki, Y.M.; Qadir, J.; Ghaly, M.; Abdelkareem, M.; Al-Ansari, A. A “True Lifecycle Approach” towards governing healthcare AI with the GCC as a global governance model. npj Digit. Med. 2025, 8, 337. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Collins, B.X.; Bélisle-Pipon, J.-C.; Evans, B.J.; Ferryman, K.; Jiang, X.; Nebeker, C.; Novak, L.; Roberts, K.; Were, M.; Yin, Z. Addressing ethical issues in healthcare artificial intelligence using a lifecycle-informed process. JAMIA Open 2024, 7, ooae108. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Stogiannos, N.; O’Regan, T.; Scurr, E.; Litosseliti, L.; Pogose, M.; Harvey, H.; Kumar, A.; Malik, R.; Barnes, A.; McEntee, M.F. Lessons on AI implementation from senior clinical practitioners: An exploratory qualitative study in medical imaging and radiotherapy in the UK. J. Med. Imaging Radiat. Sci. 2025, 56, 101797. [Google Scholar] [PubMed]
- Starke, G.; Gille, F.; Termine, A.; Aquino, Y.S.J.; Chavarriaga, R.; Ferrario, A.; Hastings, J.; Jongsma, K.; Kellmeyer, P.; Kulynych, B. Finding consensus on trust in AI in health care: Recommendations from a panel of international experts. J. Med. Internet Res. 2025, 27, e56306. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bodnari, A.; Travis, J. Scaling enterprise AI in healthcare: The role of governance in risk mitigation frameworks. npj Digit. Med. 2025, 8, 272. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gundlack, J.; Thiel, C.; Negash, S.; Buch, C.; Apfelbacher, T.; Denny, K.; Christoph, J.; Mikolajczyk, R.; Unverzagt, S.; Frese, T. Patients’ Perceptions of Artificial Intelligence Acceptance, Challenges, and Use in Medical Care: Qualitative Study. J. Med. Internet Res. 2025, 27, e70487. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chen, C.; Cui, Z. Impact of AI-Assisted Diagnosis on American Patients’ Trust in and Intention to Seek Help from Health Care Professionals: Randomized, Web-Based Survey Experiment. J. Med. Internet Res. 2025, 27, e66083. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Abdelwanis, M.; Simsekler, M.C.E.; Gabor, A.F.; Sleptchenko, A.; Omar, M. Artificial intelligence adoption challenges from healthcare providers’ perspectives: A comprehensive review and future directions. Saf. Sci. 2026, 193, 107028. [Google Scholar] [CrossRef] [Scilit]
- Kandaswamy, S.; Muthu, N.; Braykov, N.; Carter, R.; Blanco, R.; Bui, T.; Orenstein, E.; Mai, M. Human performance evaluation of a pediatric artificial intelligence sepsis model. J. Am. Med. Inform. Assoc. 2025, 32, 1552–1561. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Jain, S.S.; Goto, S.; Hall, J.L.; Khan, S.S.; MacRae, C.A.; Ofori, C.; Pegus, C.; Pencina, M.; Peterson, E.D.; Schwamm, L.H. Pragmatic Approaches to the Evaluation and Monitoring of Artificial Intelligence in Health Care: A Science Advisory from the American Heart Association. Circulation 2025, 152, e433–e442. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bailo, P.; Nittari, G.; Pesel, G.; Basello, E.; Spasari, T.; Ricci, G. Governing Healthcare AI in the Real World: How Fairness, Transparency, and Human Oversight Can Coexist: A Narrative Review. Sci 2026, 8, 36. [Google Scholar] [CrossRef] [Scilit]
- Mertz, M.; Toskovich, K.; Shields, G.; Attema, G.; Dumond, J.; Cameron, E. Exploring trust factors in AI-healthcare integration: A rapid review. Front. Artif. Intell. 2025, 8, 1658510. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Salwei, M.E.; Carayon, P. A sociotechnical systems framework for the application of artificial intelligence in health care delivery. J. Cogn. Eng. Decis. Mak. 2022, 16, 194–206. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Matthieu, V.; Alexei, S. The resilience of complex sociotechnical systems: A meta-review of conceptualisations. Systems 2026, 14, 71. [Google Scholar] [CrossRef] [Scilit]
- Sáez, C.; Ferri, P.; García-Gómez, J.M. Resilient artificial intelligence in health: Synthesis and research agenda toward next-generation trustworthy clinical decision support. J. Med. Internet Res. 2024, 26, e50295. [Google Scholar] [CrossRef] [Scilit] [PubMed]






| Dimension | Responsible-AI/Ethics Frameworks | Socio-Technical Systems View | HCEE (This Study) |
|---|---|---|---|
| Primary object | Normative principles and approval criteria | Interdependence of people, rules, technology | Operational control logic linking experience to adjustment |
| Status of experience | Ex-post acceptability/satisfaction outcome | Contextual factor | Real-time governance input signal (PXI, EXI) |
| Mechanism | Guidelines, audits, compliance checks | Conceptual/analytical description | Trigger-control rules + adaptive learning in a closed loop |
| Temporal mode | Mostly static/periodic review | Variable | Continuous sense–interpret–adjust–learn cycle |
| Testability | Principle articulation | Framework-level | Simulation-observable behavior and ordering |
| Scenario | Governance Module Activation | What Changes in the System | Expected Dynamic Signature | |||
|---|---|---|---|---|---|---|
| Sense | Control | Learn | Stress | |||
| S1 No Governance (Baseline) | OFF | OFF | OFF | OFF | Unregulated AI deployment. PXI/EXI signals are generated but neither captured nor routed to governance. No intervention mechanism operates. | Drift + error accumulation: persistent oscillation in PXI/EXI; no corrective feedback; system diverges from safe operating band over time. |
| S2 Partial HCEE (Sense-only) | ON | OFF | OFF | OFF | PXI/EXI monitored and reported; no automated control action. Signals are visible but the feedback loop remains open—correction depends on manual response. | Delayed response + residual instability: partial improvement in mean PXI/EXI; oscillation persists due to open-loop architecture; no stabilization of variance achieved. |
| S3 Full HCEE (Closed-loop) | ON | ON | ON | OFF | Full closed-loop activated: PXI/EXI signals trigger automated control adjustments (AAL/HOI/TR/IF); trigger-control rules are updated through the learning module. System self-regulates without external intervention. | Recurrent feedback-based adjustment: PXI/EXI signals are continuously incorporated into control and learning, shaping a more coordinated operational trajectory. |
| S4 Stress Test (Full + Shock) | ON | ON | ON | ON | All modules active; exogenous shocks injected (demand surge, misdiagnosis event, staff shortage, regulatory change). System responds under full closed-loop governance. | Post-stress adaptive readjustment: following an initial disruption, PXI/EXI signals are re-incorporated into control and learning, shaping a recovery and re-stabilization trajectory under exogenous stress. |
| Construct/Variable | Operational Definition | Measurement/Data Source | Trigger Condition or Evaluation Rule | Immediate Control Direction | Analytical Use |
|---|---|---|---|---|---|
| PXI (Patient Experience Index) | A composite index representing the system-level state of patient-side experience. Used as a governance input signal reflecting cumulative outcomes of repeated interactions, rather than a single satisfaction score. | Weekly and longitudinal PXI outputs within the simulation. Longitudinal snapshots (364 ticks) and weekly tracking are used in parallel. | TC-01: PXI < 70 (weekly moving average) | AAL decrease, TR activation, IF increase | Cross-scenario comparison of patient-side experience outcomes, time-path analysis, trigger activation assessment |
| EXI (Employee Experience Index) | A composite index representing the system-level state of employee-side experience. Used as a governance input signal reflecting operational experience changes including workload, sense of control, and interaction tension. | Weekly and longitudinal EXI outputs within the simulation. Longitudinal snapshots and weekly tracking are used in parallel. | TC-02: EXI < 65 (weekly moving average) | HOI increase, IF decrease, conditional TR adjustment as needed | Cross-scenario comparison of employee-side experience outcomes, detection of workload-related deterioration |
| PXI–EXI Gap | A cross-domain indicator representing the degree of imbalance between patient experience and employee experience. | Calculated based on the difference between smoothed PXI and EXI values. | TC-03: |PXI − EXI| > 15 (weekly moving average) | Cross-rebalancing toward the lower-performing domain; AAL↓ when PXI is inferior, HOI↑ when EXI is inferior, TR/IF adjustment as needed | Cross-domain balance evaluation rather than single-metric optimization |
| Terminal Snapshot Outcomes | Final state at the end of each simulation run. | Final PXI/final EXI at tick 364 (=Week 52). | N/A | N/A | Cross-scenario comparison of terminal outcomes, calculation of improvement rate vs. baseline |
| Weekly Trajectory Measures | Dynamic data showing adaptive pathways and adjustment patterns over time. | PXI/EXI time series accumulated in the weekly tracking file. | Used to verify threshold crossing, recovery timing, and re-stabilization. | Confirmation of time-path of control action following trigger firing | Interpretation of path dependency, recovery speed, and re-stabilization patterns |
| Stabilization Indicator | An operational indicator assessing whether PXI/EXI fluctuation is maintained within an acceptable range. | Assessed based on weekly trend, oscillation amplitude, and variance trend. | Determined by whether the system continuously remains within the target band after returning to it. | N/A (evaluation metric) | Review of stabilization effects for RQ2, S1–S3 comparison |
| Equity/Vulnerable Subgroup Signal | Signal related to vulnerable subgroups or experienced disparities. | Vulnerable subgroup PXI gap, complaint/anomaly signals. | Used as a supplementary signal for governance review when rapid gap widening or threshold breach occurs. | Connected as input for enhanced sampling or higher-level review | Detection of community-facing inequality beyond simple average outcomes |
| Operational/Event Variables | Operational change variables such as system errors, response delays, and complaint events. | System event logs, anomaly flags, complaint counts. | Refer to separate rulebook when safety-critical events such as AI error clusters occur. | Emergency AAL step-down, HOI reinforcement, etc., as needed | Supplementary interpretation of stress response and operational instability |
| Signal Smoothing/Detection Window | Signal processing rules to reduce trigger over-sensitivity. | Exponential smoothing (α = 0.3), 7-day rolling average. | Applied to the base detection window for TC-01 through TC-03. | False-positive trigger mitigation | Ensuring signal stabilization and reproducible trigger evaluation |
| Baseline Setting Types | A classification distinguishing the source and purpose of parameter configurations. | Empirical/stylized/calibrated/stress settings. | N/A | N/A | Explicit documentation of parameter provenance and securing reproducibility |
| Experiment | Analytical Purpose | Varied Parameter(s) | Levels Scenarios | Total Runs |
|---|---|---|---|---|
| Robustness_SeedCheck | Probabilistic robustness | sim-seed (1–30) | 30 × 3 scenarios | 90 |
| Sensitivity_Alpha | Learning-rate sensitivity | α ∈ {0.16, 0.18, 0.20, 0.22, 0.24} | 5 × 3 scenarios | 15 |
| Sensitivity_Agents | Population-scale sensitivity | n-scale = 1–5 | 5 × 3 scenarios | 15 |
| Sensitivity_InteractProb | Interaction sensitivity | patient-prob × worker-prob | 20 × 3 scenarios | 60 |
| Total | 180 |
| Item | Confirmed Value | Interpretive Meaning |
|---|---|---|
| Main terminal experiment | 1000 runs per scenario | Used for terminal snapshot comparisons in Table 5 |
| Weekly tracking experiment | 50 runs per scenario × ticks 0–364 | Used for trajectory summaries and shock–recovery landmarks in Tables 6 and 7 |
| Simulation horizon | 52 weeks (1 year) | Analytical horizon for the annual simulation cycle |
| Terminal snapshot | Tick 364 | Reference point for terminal PXI/EXI values |
| Common initial PXI | 69.88 at tick 0 across S1–S4 | Shared baseline state for weekly trajectory comparison |
| Common initial EXI | 65.10 at tick 0 across S1–S4 | Shared baseline state for weekly trajectory comparison |
| Scenario | Sense | Control | Learn | Stress | Active Governance State | Implementation Note |
|---|---|---|---|---|---|---|
| S1 No Governance | OFF | OFF | OFF | OFF | Open-loop baseline | Experience signals are generated but not routed to governance |
| S2 Partial HCEE | ON | OFF | OFF | OFF | Sensing without closed-loop adjustment | Experience is monitored, but control and learning remain inactive |
| S3 Full HCEE | ON | ON | ON | OFF | Full closed-loop governance | Sensing, adjustment, and learning are integrated |
| S4 Stress Test | ON | ON | ON | ON | Full closed-loop under exogenous stress | Full governance retained while stress module is activated |
| Scenario | Governance Condition | Terminal PXI | Terminal EXI | Change vs. S1 | Interpretation |
|---|---|---|---|---|---|
| S1 | No Governance | 58.22 | 51.90 | Reference baseline | Lowest terminal state under open-loop operation |
| S2 | Partial HCEE | 65.52 | 61.08 | PXI +7.30; EXI +9.18 | Sensing alone improves outcomes, but correction remains limited |
| S3 | Full HCEE | 78.29 | 74.50 | PXI +20.07 (+34.5%); EXI +22.60 (+43.6%) | Closed-loop governance yields the strongest non-stress terminal performance |
| S4 | Stress Test | 88.02 | 85.36 | PXI +29.80 (+51.2%); EXI +33.46 (+64.5%) | Under stress, the architecture recovers and reaches the highest terminal state |
| Scenario | Start PXI | Minimum PXI (tick) | Final PXI | Start EXI | Minimum EXI (tick) | Final EXI | Trajectory Interpretation |
|---|---|---|---|---|---|---|---|
| S1 | 69.88 | 58.11 (126) | 58.22 | 65.10 | 51.62 (93) | 51.90 | Sustained decline followed by convergence to a low operating level |
| S2 | 69.88 | 65.45 (68) | 65.52 | 65.10 | 60.85 (344) | 61.08 | Partial buffering of decline, then stabilization at an intermediate level |
| S3 | 69.88 | 68.25 (1) | 78.29 | 65.10 | 62.65 (1) | 74.50 | Brief initial adjustment followed by rebound and upward stabilization |
| S4 | 69.88 | 68.18 (1) | 88.02 | 65.10 | 62.35 (1) | 85.36 | Initial disruption followed by recovery, reinforcement, and the strongest terminal trajectory |
| Landmark | PXI Evidence | EXI Evidence | Approximate Tick/Week | Interpretation |
|---|---|---|---|---|
| Initial disruption | 69.88 → 68.18 | 65.10 → 62.35 | Tick 1/Week 0.1 | Stress produces an immediate but limited early decline |
| Recovery reinforcement begins | Intensify factor first increases from 1.00 to 1.15 | Same pattern | Tick 57/Week 8.1 | The architecture shifts from absorption to reinforced correction |
| Sustained cross-over over S3 | S4 PXI remains above S3 from tick 59 onward | S4 EXI remains above S3 from tick 58 onward | Ticks 58–59/Weeks 8.3–8.4 | S4 no longer only recovers; it overtakes the non-stress full-governance trajectory |
| First post-shock plateau | PXI fluctuates around ~80.78–80.98 | EXI fluctuates around ~77.73–78.02 | Ticks 80–100/Weeks 11.4–14.3 | A stable post-shock operating band emerges before later reinforcement steps |
| Later reinforcement phases | Intensify factor rises again at ticks 113, 169, and 225 | Same pattern | Weeks 16.1, 24.1, and 32.1 | S4 continues adaptive amplification through staged reinforcement |
| Terminal state | Final PXI = 88.02 | Final EXI = 85.36 | Tick 364/Week 52 | S4 ends at the highest terminal level among all scenarios |
| Validation File | Tested Conditions | Ordering Stability | Interpretation |
|---|---|---|---|
| Robustness_SeedCheck (v3) | 30 seeds | 30/30 runs preserved S1 < S2 < S3 | Scenario gradient remains stable under seed perturbation |
| Sensitivity_Alpha (v2) | 5 alpha levels | 5/5 settings preserved S1 < S2 < S3 | Results remain stable under moderate learning-rate variation |
| Sensitivity_Agents (v3) | 5 scale conditions | 5/5 settings preserved S1 < S2 < S3 | Scenario ordering remains robust under agent-scale change |
| Sensitivity_InteractProb (v3) | 20 interaction-probability combinations | 20/20 settings preserved S1 < S2 < S3 | Relationship-density variation does not overturn the main pattern |
| Measure/Scenario | Mean ± SD | 95% CI | ANOVA/Tukey |
|---|---|---|---|
| PXI—S1 | 58.26 ± 0.08 | [58.23, 58.29] | F(2,87) = 477,528.23, p < 0.001; Tukey S1 < S2 < S3 |
| PXI—S2 | 65.60 ± 0.09 | [65.57, 65.63] | |
| PXI—S3 | 78.44 ± 0.08 | [78.41, 78.46] | |
| EXI—S1 | 52.09 ± 0.15 | [52.04, 52.14] | F(2,87) = 151,107.39, p < 0.001; Tukey S1 < S2 < S3 |
| EXI—S2 | 61.35 ± 0.17 | [61.29, 61.41] | |
| EXI—S3 | 74.62 ± 0.16 | [74.56, 74.67] |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Kim, M.; Chang, J. Healthcare AI Governance as a Closed-Loop: A Simulation Based Analysis of Human-Centered Experience Engineering. Systems 2026, 14, 777. https://doi.org/10.3390/systems14070777
Kim M, Chang J. Healthcare AI Governance as a Closed-Loop: A Simulation Based Analysis of Human-Centered Experience Engineering. Systems. 2026; 14(7):777. https://doi.org/10.3390/systems14070777
Chicago/Turabian StyleKim, Minseong, and Joongho Chang. 2026. "Healthcare AI Governance as a Closed-Loop: A Simulation Based Analysis of Human-Centered Experience Engineering" Systems 14, no. 7: 777. https://doi.org/10.3390/systems14070777
APA StyleKim, M., & Chang, J. (2026). Healthcare AI Governance as a Closed-Loop: A Simulation Based Analysis of Human-Centered Experience Engineering. Systems, 14(7), 777. https://doi.org/10.3390/systems14070777

