Negotiating Human–AI Complementarity in Geriatric and Palliative Care: A Qualitative Study of Healthcare Practitioners’ Perspectives in Northeast China
Abstract
1. Introduction
- How do healthcare practitioners in resource-constrained settings interpret and navigate the role of AI in supporting, extending or reshaping their clinical and ethical responsibilities within integrated geriatric and palliative care?
- In what ways do human–AI interactions foster collaboration, generate tension or necessitate negotiation in the provision of care for older adults living with frailty or serious illness?
2. Materials and Methods
2.1. Research Design
2.2. Data Collection
2.3. Data Analysis
3. Results
3.1. Tensions Between AI’s Rule-Based Logic and Practitioners’ Human-Centred Approach
Participant 02 (nurse): “When you search using AI tools like DeepSeek or Doubao, it gives you quick answers, sometimes linking to extra features or content that you have to pay for. But really, it just helps you find information; it doesn’t think for you.”
Participant 09 (nurse): “Because the severity of the disease varies from patient to patient, we sometimes need to rely on our experience or observe carefully in the moment to understand what’s really going on, something AI can’t fully do yet.”
Participant 12 (doctor): “AI, including any robots we might see in the future, just can’t match human expression or language. The same sentence said with a different tone or speed can mean something completely different. Some doctors might have fewer patients because they focus on quality, but they spend more time communicating. A smile, good care, or just visiting a patient regularly can make them feel satisfied, and that helps them recover faster. I’ve seen plenty of examples where the medicine and treatment are the same, but if a patient has a bad attitude, they don’t feel it’s working. They might stay a few days, then think it’s no good, and stop the treatment.”
Participant 05 (nurse): “For patients, especially those who are middle-aged or older and unfamiliar with AI, there can be a feeling of uncertainty and insecurity about accepting it in their care.”
Participant 08 (nurse): “When a patient is in extreme pain, they can become very impatient. We might tell them about other patients with similar pain who found relief through painkillers. Sometimes, we just chat about everyday life to distract them, then gently remind them of precautions. AI can support this by providing information or suggestions, but the real connection comes from asking questions like, ‘What did you do before that made you feel happy or proud?’ Often, the patient becomes really proud, and then they don’t need much more chatting. They start to open up and talk to you to take their mind off the pain.”
3.2. Ethical Discomfort Around Human–AI Complementarity
Participant 04 (nurse): “I don’t think it will work in the future. What really matters to patients is your attitude: whether you are patient with them, whether you truly listen. AI can’t replace the warmth and empathy of human care, and that could mean older people’s emotional needs are simply ignored.”
Participant 11 (doctor): “Many patients and families are not very familiar with AI. They are often in their fifties or older. To be honest, their generation is not very comfortable with new technologies, especially since we are in the countryside, and this area is relatively underdeveloped. Honestly, they really do not know much about it. They have not had much exposure to these things, and frankly, they are not very good at accepting new stuff.”
Participant 05 (nurse): “I’m not sure it’s right for AI to make judgements about patients’ symptoms. When someone is approaching the end of their life, they often cry out in pain, but AI might misinterpret this as anger or another emotion and trigger the wrong response. There’s also the danger that AI systems lack sensitivity to individual symptoms and cultural differences, overlooking the specific needs of minority patients and creating serious ethical risks.”
3.3. Structural Inequalities in the Adoption of AI in Care
Participant 09: “In the care setting for ageing and terminal patients, where patients often face complex conditions and uncertain outcomes, patients tend to trust Doubao’s professional judgement more when it appears as a report. Sometimes they don’t believe what we usually say… They think it’s specialised, and if they can’t understand it, they assume it might be more accurate.”
Participant 14 (doctor): “The patient had been to many big hospitals before, such as haematology departments in Beijing, Shenyang, and Tianjin. He had also received treatment at our city’s best hospital. When he saw that his test results were even better than before, he thought I, as the doctor, was making a bit of a fuss. So he just didn’t understand.”
Participant 14 (GP): “Medical records are mainly written strictly in accordance with the national medical records… Copy and paste are not allowed in the system… I will only use AI to help write medical records if it is allowed in the future.”
Participant 14 (GP): “It’s accurate, but I don’t rely on [DeepSeek] completely. I’ll look at the phone again and check the textbook myself.”
Participant 05 (nurse): “In our hospital, we don’t have much access to specialist training or up-to-date reference materials, so I sometimes learn alongside my patients. When I was giving moxibustion, one patient used Doubao on his phone to check what I had explained. The information he found was almost exactly what I’d told him. When patients see my explanation matches what Doubao says, they trust me more; and it helps me feel more confident too.”
4. Discussion
Limitations and Implications
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| AI | Artificial Intelligence |
| ANT | Actor–Network Theory |
Appendix A
| Interview Questions: |
|---|
| (1) the everyday challenges and dilemmas faced by practitioners in geriatric and palliative care |
| Could you briefly describe the key challenges you have encountered or anticipate in managing relationships with patients in your palliative care training and practice? |
| How do you currently address or cope with these challenges in your work? |
| (2) attitudes, understandings, and levels of engagement with AI technologies: |
| Could you share any personal experiences or examples of interacting with AI technologies in your nursing practice? How have these experiences shaped your views on AI’s potential impact? |
| What is your general understanding of AI applications in palliative care? Are you familiar with them? (If yes, could you elaborate?) |
| (3) how practitioners perceive and manage the integration (or lack) of AI tools in their professional routines. |
| Do you believe you can effectively collaborate with AI for palliative care patients? In what ways? |
| What predictions or interpretations do you have regarding future nursing scenarios and evolving interpersonal dynamics? |
| Do you believe AI can effectively help address interpersonal challenges in palliative care? Why or why not? What expectations or recommendations do you have for future development? |
| (4) open-Ended Invitation: |
| Is there anything else you would like to share regarding human-AI complementarity in geriatric and palliative care? |
| Theme | Sub-Theme | Illustrative Participant Quote |
|---|---|---|
| Tensions between AI’s rule-based logic and practitioners’ human-centred approach | The non-transferable core of care provided by humans | ‘Personally, I do not think it’s (refer to assistants in healthcare) possible (to replace human), because everyone’s emotions are unique. AI can only be programmed with one emotion, or multiple ones—dozens or even hundreds. But each person’s emotional landscape is different.’ Participant 05 (nurse) |
| The conceptualisation of AI as a new rule-based knowledge base | ‘AI is part of some commonly used office software that assists me with tasks like writing articles or consulting on questions... Unlike traditional online consultations on official platforms, which often fail to provide a definitive answer, AI assistant is far more efficient and accurate. As soon as you describe the condition, we can immediately get the right answers.’ Participant 02 (nurse) | |
| Ethical discomfort around human–AI complementarity | The risk of depersonalised care | ‘Initially, there would always be one or two patients every day who would pick a fight with you. You’re already providing excellent care, being very gentle and attentive to them. But if you show excessive concern, they may perceive you as bothersome, they just want to undergo the treatment quietly in peace. Your excessive questioning might irritate them, and they could even end up yelling at you... AI cannot handle or help resolve these kinds of issues’. Participant 04 (nurse) |
| ‘Some patients who dislike AI should prefer face-to-face conversations, while others should like more accurate data.’ Participant 04 (nurse) | ||
| The digital literacy–consent gap among older patients | ‘Regarding middle-aged and elderly patients, they may lack prior exposure to such technologies and consequently find them difficult to accept... I perceive this primarily as resistance to novel technologies, rooted in their belief that human-provided services feel more reliable. When it comes to artificial intelligence, they likely experience a sense of insecurity stemming from the unknown.’ Participant 05 (nurse) | |
| Structural inequalities in the adoption of AI in care | Entrenched occupational hierarchies within hospitals | ‘Because he’s supposed to think of it as a small thing. He thinks it won’t be able to affect the results of the medical examination. But it won’t. It is something that can affect the results of the medical examination.’ Participant 06 (nurse) |
| Pronounced regional disparities | Researcher: ‘Have there been any training sessions on the use of AI provided by local health and wellness commissions or other related research and teaching institutions for you?’ Participant 01 (nurse): ‘Not yet.’ |
References
- Knaul, F.M.; Arreola-Ornelas, H.; Kwete, X.J.; Bhadelia, A.; Rosa, W.E.; Touchton, M.; Méndez-Carniado, O.; Enciso, V.V.; Pastrana, T.; Friedman, J.R.; et al. The evolution of serious health-related suffering from 1990 to 2021: An update to The Lancet Commission on global access to palliative care and pain relief. Lancet Glob. Health 2025, 13, e422–e436. [Google Scholar] [CrossRef]
- Brondeel, K.C.; Duncan, S.A.; Luther, P.M.; Anderson, A.; Bhargava, P.; Mosieri, C.; Ahmadzadeh, S.; Shekoohi, S.; Cornett, E.M.; Fox, C.J.; et al. Palliative Care and Multi-Agent Systems: A necessary paradigm shift. Clin. Pract. 2023, 13, 505–514. [Google Scholar] [CrossRef]
- Castagna, A.; Militano, V.; Ruberto, C.; Manzo, C.; Ruotolo, G. Comprehensive geriatric assessment and palliative care. Aging Med. 2024, 7, 645–648. [Google Scholar] [CrossRef]
- Pacala, J.T. Is Palliative Care the “New” Geriatrics? Wrong Question-We’re Better Together. J. Am. Geriatr. Soc. 2014, 62, 1968–1970. [Google Scholar] [CrossRef]
- Schelin, M.E.C.; Fürst, C.J.; Rasmussen, B.H.; Hedman, C. Increased patient satisfaction by integration of palliative care into geriatrics—A prospective cohort study. PLoS ONE 2023, 18, e0287550. [Google Scholar] [CrossRef]
- Zhang, H.; Ma, F.; Zhang, H.; Shi, J. Research on Geriatric Education based on the Concept of Palliative Care. Int. J. Geriatr. 2024, 45, 381–384. (In Chinese) [Google Scholar] [CrossRef]
- Atreya, S.; Sinha, A.; Kumar, R. Integration of primary palliative care into geriatric care from the Indian perspective. J. Fam. Med. Prim. Care 2022, 11, 4913–4918. [Google Scholar] [CrossRef]
- State Council. The 14th Five-Year Plan for the Development of National Aging Services and the Elderly Care Service System in China. 2021. Available online: https://www.gov.cn/zhengce/content/2022-02/21/content_5674844.htm (accessed on 12 May 2025).
- Office of the National Health Commission. The National Health Commission Has Issued the Guidelines for the Construction and Management of Geriatrics (2025 Edition). 2025. Available online: https://www.nhc.gov.cn/yzygj/c100068/202505/cb8fc8b895b142938027facaeee62e90.shtml (accessed on 12 May 2025).
- Yang, L.; Zhao, K.; Fan, Z. Exploring determinants of population ageing in Northeast China: From a socio-economic perspective. Int. J. Environ. Res. Public Health 2019, 16, 4265. [Google Scholar] [CrossRef]
- Zhou, Y.; Yao, Y.; Ye, X. A qualitative study on the acceptance Attitude of Elderly Care Robots Based on Value Perception. Nurs. Res. 2025, 39, 381–387. (In Chinese) [Google Scholar]
- Guo, J.; Xiao, Y.; Chen, Y. Research Status of Smart Healthcare in Home-based palliative care. Chin. J. Geriatr. Mult. Organ Dis. 2022, 21, 840–844. (In Chinese) [Google Scholar]
- He, L. Research on the Intervention Design of AI+ Online Social Work Services in Hospice Care. J. East China Univ. Sci. Technol. 2024, 39, 27–44. (In Chinese) [Google Scholar]
- China Internet Network Information Center. Generative Artificial Intelligence Application Development Report; China Internet Network Information Center: Beijing, China, 2024. Available online: http://www.sccio.cn/uploads/20241212/bee175a16ef20aa7188b29e1f18f6ade.pdf (accessed on 12 May 2025).
- Inkpen, K.; Chappidi, S.; Mallari, K.; Nushi, B.; Ramesh, D.; Michelucci, P.; Mandava, V.; Vepřek, L.H.; Quinn, G. Advancing Human-AI complementarity: The impact of user expertise and algorithmic tuning on joint decision making. ACM Trans. Comput. Hum. Interact. 2023, 30, 1–29. [Google Scholar] [CrossRef]
- Hemmer, P.; Schemmer, M.; Kühl, N.; Vössing, M.; Satzger, G. Complementarity in Human-AI Collaboration: Concept, sources, and evidence. Eur. J. Inf. Syst. 2025, 1–24. [Google Scholar] [CrossRef]
- Sharma, A.; Lin, I.W.; Miner, A.S.; Atkins, D.C.; Althoff, T. Human–AI collaboration enables more empathic conversations in text-based peer-to-peer mental health support. Nat. Mach. Intell. 2023, 5, 46–57. [Google Scholar] [CrossRef]
- Clay, T.J.; Da Custodia Steel, Z.J.; Jacobs, C. Human-Computer Interaction: A Literature review of Artificial intelligence and Communication in healthcare. Cureus 2024, 16, e73763. [Google Scholar] [CrossRef]
- Jia, Y.; Evans, H.; Porter, Z.; Graham, S.; McDermid, J.; Lawton, T.; Snead, D.; Habli, I. The case for delegated AI autonomy for Human AI teaming in healthcare. arXiv 2025, arXiv:2503.18778. [Google Scholar] [CrossRef]
- Odionu, C.; Pub, A. The Role of Data Analytics in Enhancing Geriatric Care: A Review of AI-Driven Solutions. Int. J. Multidiscip. Res. Growth Eval. 2025, 5, 1131–1138. [Google Scholar] [CrossRef]
- Avati, A.; Jung, K.; Harman, S.; Downing, L.; Ng, A.; Shah, N.H. Improving Palliative Care with Deep Learning. BMC Med. Inform. Decis. Mak. 2018, 18, 55–64. [Google Scholar] [CrossRef]
- Chen, D.; Yoon, H.J.; Wan, Z.; Alluru, N.; Lee, S.W.; He, R.; Moore, T.J.; Nelson, F.F.; Yoon, S.; Lim, H. Advancing Human-Machine Teaming: Concepts, Challenges, and Applications. arXiv 2025, arXiv:2503.16518. [Google Scholar]
- Bressler, T.; Song, J.; Kamalumpundi, V.; Chae, S.; Song, H.; Tark, A. Leveraging Artificial Intelligence/Machine Learning Models to identify potential palliative care beneficiaries: A systematic review. J. Gerontol. Nurs. 2024, 51, 7–14. [Google Scholar] [CrossRef]
- Wang, J. Is robot-assisted elderly care the solution to the aging problem?—From the perspective of Confucian role ethics. Confucius Stud. 2024, 6, 5–14. (In Chinese) [Google Scholar]
- Abiodun, A.; Akingbola, A.; Ojo, O.; Jessica, O.U.; Alao, U.H.; Shagaya, U.; Adewole, O.; Abdullahi, O. Ethical challenges in the integration of artificial intelligence in palliative care. J. Med. Surg. Public Health 2024, 4, 100158. [Google Scholar] [CrossRef]
- De Panfilis, L.; Peruselli, C.; Tanzi, S.; Botrugno, C. AI-based clinical decision-making systems in palliative medicine: Ethical challenges. BMJ Support. Palliat. Care 2023, 13, 183–189. [Google Scholar] [CrossRef]
- Nasarian, E.; Alizadehsani, R.; Acharya, U.; Tsui, K. Designing interpretable ML system to enhance trust in healthcare: A systematic review to proposed responsible clinician-AI-collaboration framework. Inf. Fusion 2024, 108, 102412. [Google Scholar] [CrossRef]
- Gómez-García, M.; Ruiz-Palmero, J.; Boumadan-Hamed, M.; Soto-Varela, R. Percepciones de futuros docentes y pedagogos sobre uso responsable de la IA. Un instrumento de medida. RIED Rev. Iberoam. Educ. Distancia 2025, 28, 105–130. [Google Scholar] [CrossRef]
- Naughton, M.; Salmon, P.M.; Compton, H.R.; McLean, S. Challenges and opportunities of artificial intelligence implementation within sports science and sports medicine teams. Front. Sports Act. Living 2024, 6, 1332427. [Google Scholar] [CrossRef]
- Akhras, N.; Antaki, F.; Mottet, F.; Nguyen, O.; Sawhney, S.; Bajwah, S.; Davies, J.M. Large language models perpetuate bias in palliative care: Development and analysis of the Palliative Care Adversarial Dataset (PCAD). arXiv 2025, arXiv:2502.08073. [Google Scholar] [CrossRef]
- Sattar, K.; Yusoff, M.S.B. Embracing the Future: Nurturing Medical Professionalism through the Integration of Artificial Intelligence. Educ. Med. J. 2024, 16, 1–3. [Google Scholar] [CrossRef]
- Allen, M.R.; Webb, S.; Mandvi, A.; Frieden, M.; Tai-Seale, M.; Kallenberg, G. Navigating the doctor-patient-AI relationship—A mixed-methods study of physician attitudes toward artificial intelligence in primary care. BMC Prim. Care 2024, 25, 42. [Google Scholar] [CrossRef]
- Dean, T.B.; Seecheran, R.; Badgett, R.G.; Zackula, R.; Symons, J. Perceptions and attitudes toward artificial intelligence among frontline physicians and physicians’ assistants in Kansas: A cross-sectional survey. JAMIA Open 2024, 7, ooae100. [Google Scholar] [CrossRef]
- Sahoo, R.K.; Sahoo, K.C.; Negi, S.; Baliarsingh, S.K.; Panda, B.; Pati, S. Health Professionals’ Perspectives on the Use of Artificial Intelligence in Healthcare: A Systematic review. Patient Educ. Couns. 2025, 134, 108680. [Google Scholar] [CrossRef]
- Celi, L.A.; Cellini, J.; Charpignon, M.; Dee, E.C.; Dernoncourt, F.; Eber, R.; Mitchell, W.G.; Moukheiber, L.; Schirmer, J.; Situ, J.; et al. Sources of bias in artificial intelligence that perpetuate healthcare disparities—A global review. PLoS Digit. Health 2022, 1, e0000022. [Google Scholar] [CrossRef]
- Latour, B. Reassembling the Social: An Introduction to Actor-Network-Theory; Oxford University Press: Oxford, UK, 2005. [Google Scholar] [CrossRef]
- Law, J. Actor network theory and material semiotics. In The New Blackwell Companion to Social Theory; Turner, B.S., Ed.; Wiley-Blackwell: Chichester, UK, 2009; pp. 141–158. [Google Scholar]
- Wynn, M.; Garwood-Cross, L. Reassembling nursing in the digital age: An actor-network theory perspective. Nurs. Inq. 2024, 31, e12655. [Google Scholar] [CrossRef] [PubMed]
- Landers, A.; Pitama, S.G.; Palmer, S.C.; Beckert, L. Positioning Stakeholder Perspectives in COPD End-of-Life Care Using Critical Theory and Actor-Network Theory: A Methodological approach. Int. J. Qual. Methods 2023, 22, 16094069231214098. [Google Scholar] [CrossRef]
- Chen, Y. Regional decline and structural changes in Northeast China: An exploratory space–time approach. Asia Pac. J. Reg. Sci. 2024, 8, 397–427. [Google Scholar] [CrossRef]
- Zhang, R.; Li, H.; Meng, H.; Zhan, J.; Gan, H.; Lee, Y.C. The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships. arXiv 2024, arXiv:2410.20130. [Google Scholar]
- Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef]
- Neff, G. Talking to bots: Symbiotic Agency and the case of Tay. Int. J. Commun. 2016, 10, 4915–4931. Available online: https://ora.ox.ac.uk/objects/uuid:613f7303-8a07-4f5a-ada2-b495c9a449af (accessed on 28 July 2025).
- Wu, F. Suicide and Justice; China Renmin University Press: Beijing, China, 2009. (In Chinese) [Google Scholar]
- Tully, S.; Longoni, C.; Appel, G. Express: Lower Artificial Intelligence literacy predicts Greater AI receptivity. J. Mark. 2025, 89, 00222429251314491. [Google Scholar] [CrossRef]
- Wernly, B.; Guidet, B.; Beil, M. The role of artificial intelligence in life-sustaining treatment decisions: Current state and future considerations. Intensive Care Med. 2025, 51, 157–159. [Google Scholar] [CrossRef]
- Badawy, W.; Shaban, M. Exploring geriatric nurses’ perspectives on the adoption of AI in elderly care a qualitative study. Geriatr. Nurs. 2025, 61, 41–49. [Google Scholar] [CrossRef] [PubMed]
- Tomlinson, K.; Jaffe, S.; Wang, W.; Counts, S.; Suri, S. Working with AI: Measuring the Occupational Implications of Generative AI. arXiv 2025, arXiv:2507.07935. [Google Scholar] [CrossRef]
- Dien, D.S. Big me and little me: A Chinese perspective on self. Psychiatry J. Study Interpers. Process. 1983, 46, 281–286. [Google Scholar] [CrossRef]
- Barbalet, J. Greater Self, Lesser Self: Dimensions of Self-Interest in Chinese Filial Piety. J. Theory Soc. Behav. 2014, 44, 186–205. [Google Scholar] [CrossRef]
- Wong, P.H. Why Confucianism Matters for the Ethics of Technology. In The Oxford Handbook of Philosophy of Technology; Vallor, S., Ed.; Oxford University Press: Oxford, UK, 2022; pp. 609–628. [Google Scholar] [CrossRef]
- Fang, C.; Tanaka, M. An exploration of person-centred approach in end-of-life care policies in England and Japan. BMC Palliat. Care 2022, 21, 68. [Google Scholar] [CrossRef]
| Gender | Age | Years of Working Experience | Preferred AI Tool | Profession | |
|---|---|---|---|---|---|
| Participant 01 | Female | 29 | 7 | Doubao | Nurse |
| Participant 02 | Female | 24 | 3 | Doubao | Nurse |
| Participant 03 | Female | 31 | 6 | Doubao | Nurse |
| Participant 04 | Female | 23 | 1 | Doubao | Nurse |
| Participant 05 | Female | 23 | 1 | Doubao | Nurse |
| Participant 06 | Female | 25 | 1 | Doubao | Nurse |
| Participant 07 | Female | 37 | 10 | Doubao | Nurse |
| Participant 08 | Female | 51 | 32 | Doubao | Nurse |
| Participant 09 | Female | 26 | 2 | Doubao | Nurse |
| Participant 10 | Male | 59 | 36 | Cautious about AI 1 | Doctor |
| Participant 11 | Male | 47 | 30 | Cautious about AI | Doctor |
| Participant 12 | Male | 43 | 20 | Cautious about AI | Doctor |
| Participant 13 | Female | 45 | 5 | Cautious about AI | Doctor |
| Participant 14 | Male | 53 | 30 | DeepSeek | Doctor |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Guo, C.; Fang, C.; Zhang, W.; Troyer, J. Negotiating Human–AI Complementarity in Geriatric and Palliative Care: A Qualitative Study of Healthcare Practitioners’ Perspectives in Northeast China. Informatics 2025, 12, 120. https://doi.org/10.3390/informatics12040120
Guo C, Fang C, Zhang W, Troyer J. Negotiating Human–AI Complementarity in Geriatric and Palliative Care: A Qualitative Study of Healthcare Practitioners’ Perspectives in Northeast China. Informatics. 2025; 12(4):120. https://doi.org/10.3390/informatics12040120
Chicago/Turabian StyleGuo, Chenyang, Chao Fang, Wenbo Zhang, and John Troyer. 2025. "Negotiating Human–AI Complementarity in Geriatric and Palliative Care: A Qualitative Study of Healthcare Practitioners’ Perspectives in Northeast China" Informatics 12, no. 4: 120. https://doi.org/10.3390/informatics12040120
APA StyleGuo, C., Fang, C., Zhang, W., & Troyer, J. (2025). Negotiating Human–AI Complementarity in Geriatric and Palliative Care: A Qualitative Study of Healthcare Practitioners’ Perspectives in Northeast China. Informatics, 12(4), 120. https://doi.org/10.3390/informatics12040120

