Beyond Single Systems: How Multi-Agent AI Is Reshaping Ethics in Radiology
Abstract
1. Introduction
Key Terminology: Before Proceeding with Our Analysis, We Define Two Central Concepts That Frame Our Discussion
2. The Evolution from Single-Agent to Multi-Agent Radiology AI
2.1. Traditional Radiological AI: The Single-Agent Paradigm
2.2. The Emergence of Agentic Radiological AI
2.3. Multi-Agent Coordination in Radiological Workflows
2.4. Deep Learning Foundations of Multi-Agent Systems
2.5. Emerging Clinical Implementations of Multi-Agent Radiology AI
3. The Compound Opacity Problem in Multi-Agent Radiology
3.1. Beyond Traditional Black Box Challenges
- Defining Compound Opacity
- The Nature of Compound Opacity
- Inter-agent communication protocols: How agents exchange information, what representations they share, and how they interpret messages from other agents;
- Decision aggregation mechanisms: How individual agent outputs combine to produce system-level recommendations;
- Emergent behaviors: System-level patterns that arise from agent interactions but cannot be predicted from individual agent specifications;
- Temporal dependencies: How agent decisions evolve based on information received from other agents over time;
- Context-dependent coordination: How agent collaboration patterns adapt to different clinical scenarios.
3.2. The Failure of Current Explainability Methods
3.3. Error Propagation and Cascading Failures
3.4. Clinical Manifestations of Compound Opacity
4. Autonomy–Transparency Tensions in Radiological Practice
4.1. The Clinical Need for Understanding
4.2. Regulatory and Legal Implications
4.2.1. Jurisdictional Differences in Regulatory Approaches
4.2.2. Pathways for Regulatory Adaptation
4.3. Trust and Professional Identity
5. Ethical Frameworks for Multi-Agent Radiology AI
5.1. Preserving Human Agency in Diagnostic Decision-Making
5.2. Transparency Requirements and Design Principles
5.3. Accountability Mechanisms and Error Attribution
6. Technical Approaches to Multi-Agent Transparency
6.1. Hierarchical Explanation Architectures
6.2. Adversarial Agents and Internal Validation
6.3. Mechanistic Interpretability for Agent Understanding
7. Implementation Pathways and Future Directions
7.1. Staged Deployment and Risk Management
7.2. Education and Training Requirements
7.3. Research Priorities and Knowledge Gaps
8. Discussion
8.1. Balancing Innovation and Responsibility
8.2. The Future of Radiological Practice
8.3. Broader Implications for Medical AI
8.4. Limitations of This Review
9. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Faghani, S.; Moassefi, M.; Rouzrokh, P.; Khosravi, B.; Erickson, B.J. Uncover This Tech Term: Agentic Artificial Intelligence in Radiology. Korean J. Radiol. 2025, 26, 888–892. [Google Scholar] [CrossRef]
- Botti, V. Agentic AI and Multiagentic: Are We Reinventing the Wheel? arXiv 2025, arXiv:2506.01463. [Google Scholar] [CrossRef]
- Bousetouane, F. Agentic Systems: A Guide to Transforming Industries with Vertical AI Agents. arXiv 2025, arXiv:2501.00881. [Google Scholar] [CrossRef]
- Kandogan, E.; Bhutani, N.; Zhang, D.; Chen, R.L.; Gurajada, S.; Hruschka, E. Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AI. arXiv 2025, arXiv:2504.08148. [Google Scholar] [CrossRef]
- Singh, Y.; Hathaway, Q.A.; Keishing, V.; Salehi, S.; Wei, Y.; Horvat, N.; Vera-Garcia, D.V.; Choudhary, A.; Mula Kh, A.; Quaia, E.; et al. Beyond Post Hoc Explanations: A Comprehensive Framework for Accountable AI in Medical Imaging Through Transparency, Interpretability, and Explainability. Bioengineering 2025, 12, 879. [Google Scholar] [CrossRef] [PubMed]
- Borys, K.; YA, S.; Nauta, M.; Seifert, C.; Krämer, N.; CM, F.; Nensa, F. Explainable AI in Medical Imaging: An Overview for Clinical Practitioners—Saliency-Based XAI Approaches. Eur. J. Radiol. 2023, 162, 110787. [Google Scholar] [CrossRef]
- Cui, S.; Traverso, A.; Niraula, D.; Zou, J.; Luo, Y.; Owen, D.; Naqa, I.E.; Wei, L. Interpretable Artificial Intelligence in Radiology and Radiation Oncology. Br. J. Radiol. 2023, 96, 20230142. [Google Scholar] [CrossRef]
- Yi, Z.; Xiao, T.; Albert, M.V. A Multimodal Multi-Agent Framework for Radiology Report Generation. arXiv 2025, arXiv:2505.09787. [Google Scholar] [CrossRef]
- Nguyen, T.T.; Nguyen, N.D.; Nahavandi, S. Deep Reinforcement Learning for Multiagent Systems: A Review of Challenges, Solutions, and Applications. IEEE Trans. Cybern. 2020, 50, 3826–3839. [Google Scholar] [CrossRef]
- Ma, B.; Chen, Y.; Tan, J.; Yin, X.; Qin, J.; Huang, H.; Wang, H.; Xue, W.; Ban, X. Feature Disentanglement and Cross-Domain Synthesis via Federated Style Transfer for Non-IID Segmentation. Expert Syst. Appl. 2025, 296, 129059. [Google Scholar] [CrossRef]
- Qu, Y.; Zhou, X.; Huang, P.; Liu, Y.; Mercaldo, F.; Santone, A.; Feng, P. CGAM: An End-to-End Causality Graph Attention Mamba Network for Esophageal Pathology Grading. Biomed. Signal Process. Control 2025, 103, 107452. [Google Scholar] [CrossRef]
- Mulenga, R.; Shilongo, H. Hybrid and Blended Learning Models: Innovations, Challenges, and Future Directions in Education. Acta Pedagog. Asian. 2025, 4, 1–13. [Google Scholar] [CrossRef]
- Leutz-Schmidt, P.; Palm, V.; Mathy, R.M.; Grözinger, M.; Kauczor, H.U.; Jang, H.; Sedaghat, S. Performance of Large Language Models ChatGPT and Gemini on Workplace Management Questions in Radiology. Diagnostics 2025, 15, 497. [Google Scholar] [CrossRef] [PubMed]
- Saeed, W.; Omlin, C. Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities. Knowl. Based Syst. 2023, 263, 110273. [Google Scholar] [CrossRef]
- Reyes, M.; Meier, R.; Pereira, S.; Silva, C.A.; Dahlweid, F.M.; von Tengg-Kobligk, H.; Summers, R.M.; Wiest, R. On the Interpretability of Artificial Intelligence in Radiology: Challenges and Opportunities. Radiol. Artif. Intell. 2020, 2, e190043. [Google Scholar] [CrossRef]
- Chung, C.Y.; Hu, R.; Peterson, R.B.; Allen, J.W. Automated Processing of Head CT Perfusion Imaging for Ischemic Stroke Triage: A Practical Guide to Quality Assurance and Interpretation. Am. J. Roentgenol. 2021, 217, 1401–1416. [Google Scholar] [CrossRef]
- Rodríguez Ruiz, N.; Abd Own, S.; Ekström Smedby, K.; Eloranta, S.; Koch, S.; Wästerlid, T.; Krstic, A.; Boman, M. Data-Driven Support to Decision-Making in Molecular Tumour Boards for Lymphoma: A Design Science Approach. Front. Oncol. 2022, 12, 984021. [Google Scholar] [CrossRef]
- Langlotz, C.P.; Allen, B.; Erickson, B.J.; Kalpathy-Cramer, J.; Bigelow, K.; Cook, T.S.; Flanders, A.E.; Lungren, M.P.; Mendelson, D.S.; Rudie, J.D.; et al. A Roadmap for Foundational Research on Artificial Intelligence in Medical Imaging: From the 2018 NIH/RSNA/ACR/The Academy Workshop. Radiology 2019, 291, 781–791. [Google Scholar] [CrossRef]
- de Vries, B.M.; Zwezerijnen, G.J.C.; Burchell, G.L.; van Velden, F.H.P.; Menke-van der Houven van Oordt, C.W.; Boellaard, R. Explainable Artificial Intelligence (XAI) in Radiology and Nuclear Medicine: A Literature Review. Front. Med. 2023, 10, 1180773. [Google Scholar] [CrossRef]
- Milam, M.E.; Koo, C.W. The Current Status and Future of FDA-Approved Artificial Intelligence Tools in Chest Radiology in the United States. Clin. Radiol. 2023, 78, 115–122. [Google Scholar] [CrossRef]
- Aboy, M.; Minssen, T.; Vayena, E. Navigating the EU AI Act: Implications for Regulated Digital Medical Products. NPJ Digit. Med. 2024, 7, 237. [Google Scholar] [CrossRef] [PubMed]
- Fraser, A.G.; Buccheri, S.; Byrne, R.A.; Kjaersgaard-Andersen, P.; James, S.; Jüni, P.; Bally, L.; Bulbulia, R.; Koletzko, B.V.; Landray, M.J.; et al. Recommended Methodologies for Clinical Investigations of High-Risk Medical Devices—Conclusions from the European Union CORE–MD Project. Lancet Reg. Health Eur. 2025, 0, 101460. [Google Scholar] [CrossRef]
- Gille, F.; Jobin, A.; Ienca, M. What We Talk About When We Talk About Trust: Theory of Trust for AI in Healthcare. Intell. Based Med. 2020, 1–2, 100001. [Google Scholar] [CrossRef]
- Quinn, T.P.; Senadeera, M.; Jacobs, S.; Coghlan, S.; Le, V. Trust and Medical AI: The Challenges We Face and the Expertise Needed to Overcome Them. J. Am. Med. Inform. Assoc. 2021, 28, 890–894. [Google Scholar] [CrossRef]
- Rajpurkar, P.; Topol, E.J. Beyond Assistance: The Case for Role Separation in AI-Human Radiology Workflows. Radiology 2025, 316, e250477. [Google Scholar] [CrossRef]
- Moritz, M.; Topol, E.; Rajpurkar, P. Coordinated AI Agents for Advancing Healthcare. Nat. Biomed. Eng. 2025, 9, 432–438. [Google Scholar] [CrossRef]
- Gabriel, I.; Keeling, G.; Manzini, A.; Evans, J. We Need a New Ethics for a World of AI Agents. Nature 2025, 644, 38–40. [Google Scholar] [CrossRef]
Dimension | Single-Agent Opacity | Compound Opacity (Multi-Agent) |
---|---|---|
Primary Source | Internal model complexity (neural network weights, activation patterns) | Agent interactions + individual model opacity + emergent system behaviors |
Explainability Target | One decision pathway with identifiable input-output mapping | Multiple interacting decision pathways with distributed reasoning |
Transparency Methods | Saliency maps, attention visualization, feature attribution | Requires hierarchical explanations across agent communications and decision aggregation |
Error Attribution | Traceable to specific model components or training data | Distributed across multiple agents with unclear attribution |
Temporal Complexity | Static decision point amenable to snapshot analysis | Dynamic iterative exchanges with temporal dependencies |
Validation Approach | Test set evaluation with ground truth comparison | System-level behavior assessment requiring process monitoring |
Human Oversight | Review individual model outputs | Monitor agent interactions and system-level emergent behaviors |
Challenge | Description | Clinical Impact | Proposed Solution | Implementation Section |
---|---|---|---|---|
Compound Opacity | Multiplicative inscrutability arising from inter-agent interactions, distributed reasoning, and emergent system behaviors (Section 3.1) | Radiologists cannot validate AI recommendations; uncertainty about reliability of multi-step diagnostic processes | Hierarchical explanation architectures providing agent-level, interaction-level, and system-level transparency | Section 6.1 |
Explainability Method Failure | Traditional attribution techniques (saliency maps, attention visualization) inadequate for multi-agent coordination (Section 3.2) | Inability to understand how individual agent decisions aggregate into system recommendations | Natural language agent communication; audit trails documenting reasoning processes | Section 5.2 and Section 6.1 |
Error Propagation | Cascading failures as errors amplify through sequential agent workflows; system accuracy degrades multiplicatively (Section 3.3) | Compounded diagnostic errors with unclear origin; reduced reliability despite high individual agent accuracy | Adversarial agents providing internal validation; diversity of analytical approaches | Section 6.2 |
Attribution Difficulty | Unclear responsibility when errors emerge from agent interactions rather than individual component failures (Section 3.3) | Legal liability ambiguity; challenges in quality improvement and root cause analysis | Comprehensive logging systems; accountability frameworks assigning responsibility across human and artificial agents | Section 5.3 |
Trust Calibration Deficit | Radiologists cannot assess when to rely on versus question AI recommendations (Section 4.3) | Over-reliance on flawed recommendations or under-utilization of valuable insights; professional identity concerns | Staged deployment in low-risk contexts; empirical validation studies; transparency mechanisms building calibrated trust | Section 7.1 and Section 7.2 |
Regulatory Gaps | Existing frameworks inadequate for validating emergent behaviors and adaptive multi-agent coordination (Section 4.2) | Unsafe systems potentially entering practice; valuable innovations impeded by regulatory uncertainty | Adaptive regulatory frameworks; sandbox environments; certification of development processes rather than all behaviors | Section 4.2 |
Clinical Context Insensitivity | Agent decisions reflect training data and protocols that may not match local patient populations or institutional practices (Section 3.4) | Recommendations inappropriate for specific clinical contexts; reduced effectiveness across diverse settings | Mechanistic interpretability revealing agent assumptions; context-aware adaptation mechanisms | Section 6.3 and Section 7.1 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Salehi, S.; Singh, Y.; Habibi, P.; Erickson, B.J. Beyond Single Systems: How Multi-Agent AI Is Reshaping Ethics in Radiology. Bioengineering 2025, 12, 1100. https://doi.org/10.3390/bioengineering12101100
Salehi S, Singh Y, Habibi P, Erickson BJ. Beyond Single Systems: How Multi-Agent AI Is Reshaping Ethics in Radiology. Bioengineering. 2025; 12(10):1100. https://doi.org/10.3390/bioengineering12101100
Chicago/Turabian StyleSalehi, Sara, Yashbir Singh, Parnian Habibi, and Bradley J. Erickson. 2025. "Beyond Single Systems: How Multi-Agent AI Is Reshaping Ethics in Radiology" Bioengineering 12, no. 10: 1100. https://doi.org/10.3390/bioengineering12101100
APA StyleSalehi, S., Singh, Y., Habibi, P., & Erickson, B. J. (2025). Beyond Single Systems: How Multi-Agent AI Is Reshaping Ethics in Radiology. Bioengineering, 12(10), 1100. https://doi.org/10.3390/bioengineering12101100