Evaluating Generative AI for Identifying Ethical, Legal, and Social Dimensions in Migration Narratives: A Case Study of Ukrainian Discourse
Abstract
1. Introduction
2. Literature Review
2.1. Generative AI for Analysing Social Discourse
2.2. Taxonomic Challenges in Analysing ELS Dimensions from Migration Narratives
3. Materials and Methods
3.1. Data Collection
3.2. Four-Step Methodological Framework for Measuring ELS Dimensions
3.2.1. Human-in-the-Loop Development for the Migration ELS Taxonomy
3.2.2. GenAI-Based Mapping of Texts to ELS Categories
3.2.3. Validation of GenAI-Driven Classification
3.3. Research Ethics
4. Results
4.1. Migration ELS Taxonomy Development
4.2. ELS Taxonomy-Guided GenAI Classification
4.3. Results of Expert-Based Validation of GenAI-Driven Mapping
4.4. Comparative and Temporal Analysis of ELS Mapping Results
5. Discussion
Limitations
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| AI | Artificial intelligence |
| GenAI | Generative AI |
| ELS | Ethical, legal, and social |
| LLM | Large Language Model |
Appendix A

Appendix B
| Excerpt | ELS Category | Associated Narratives |
|---|---|---|
| Never in my life have I seen an international crisis where the dividing line between right and wrong has been so stark, as the Russian war machine unleashes its fury on a proud democracy. Russia’s reckless attack on the Zaporizhzhia nuclear power plant reminds us just how grave the stakes are for everyone. Millions of people are fleeing from the violence, towards an uncertain future *. […] His assault on Ukraine began with a confected pretext and a flagrant violation of international law. Now it is sinking further into a sordid campaign of war crimes and unthinkable violence against civilians. […] We must all work together to establish an immediate ceasefire and allow civilians safe passage, food and medical supplies. […] The UK has 1000 troops on standby for humanitarian operations on top of £220 million of aid. | ethics | stark moral clarity, international ethical solidarity, humanitarian responsibility, moral condemnation of violence |
| Temporary protection for displaced persons from Ukraine… temporary protection… identity document… rights to accommodation, […] The need for the draft was dictated by the management of the massive influx of displaced persons, generated by the war in the neighboring country, as well as to align with EU legislation. | legal | temporary protection regulations, registration procedures, accommodation rights |
| Spain has exceeded 180,000 temporary protections for Ukrainian refugees […] Up to 7 July 2023, the Office for Asylum for Refugees (OAR) of the Ministry of Home Affairs and the National Police have processed and granted a total of 180,785 protections. Last March, the European Commission informed the Council of Ministers for Home Affairs of the extension of temporary protection until March 2024 […]. First activation of the European directive | legal | temporary protection regulations, registration procedures, work permits. EU migration regulation |
| Commercial accommodation offers for BOTPs are currently paused to allow the Department to carry out a strategic review of its current accommodation […] The International Protection Accommodation Services (IPAS) are continuing to receive and assess offers of accommodation | legal | residence requirements, temporary protection regulations |
| Considering the current security situation in Ukraine, we inform that the Centre for Promotion of Refugees (CSPB) Eurasia continues to operate refugees in the USA (USAP).We continue to process your documents. This situation does not affect the process of considering your documents by the US Citizenship and Immigration Service (USCIS) and making the appropriate decision […] inform the Centre for Promotion of Eurasia Refugees | legal | immigration services guidance, registration procedures, immigration document processing |
| 1915 interviews with refugees from Ukraine… displacement patterns, needs and intentions… 70% intend to remain… […] By the time of the data collection, 90 per cent of the Ukrainian s have already received humanitarian assistance food supplies, personal hygiene and sanitary products, clothes and shoes mainly | social | institutional support, refugee needs monitoring |
| 1.44 million people who fled from the war in Ukraine… refugees… solidarity with residents of Ukraine… humanitarian assistance… common European task… financial assistance | social | institutional support, integration programmes, financial assistance |
| 5,562,000 returnees… conditions of return…However, higher shared of returnees in the East 9 and West 7 described their current shelter as inadequate. The low proportion of returnees residing in shelters… While the need for financial assistance was ubiquitous, male returnees were the least likely of all population groups to report this need | social | returnee demographics, integration programmes, financial assistance, accommodation policies |
| I am convinced our duty is to help people that need our help […] We implemented over 50 similar assistance projects last year, with the humanitarian and developmental cooperation of Czech firms […] new technologies in the teaching programs of medical universities, and in the development of the fields of physiotherapy and rehabilitation of children | social | humanitarian medical aid, Czech solidarity, institutional support, support for refugee children |
| Meeting family, accessing health care or obtaining new documents were the top three reasons for a short term visit to Ukraine in both quarters… immediate needs (health services, financial support)… group composition with children | social | return crossing survey, institutional support, support for refugee children |
| Excerpt * | ELS Category | Associated Narratives |
|---|---|---|
| Phishing attempts ** are increasingly appearing in chat rooms for Ukrainians […] Phishing… is a type of fraud, the purpose of which is to entice gullible or inattentive network users with personal data | ethics | protection of vulnerable groups, prevention of exploitation, personal data protection |
| …Behave like cultured people, don’t spoil your hosts’ mood. Don’t make them regret responding to our plight. If you are categorically not satisfied with Ireland, take a breath, rest a little and move on in search of the country of your dreams. | ethics | cultural adaptation rules, social responsibility, ethical integration behaviour |
| Be honest. Some choose a model of behaviour—to put pressure on pity… To say that there was an experience of living together… You know that you need to respect the rights and current life of other people… If cleanliness is important to the host, and you are not a fan, it may be possible to deceive him for a while, but then it will make everything very difficult for you… And it is imperative that the words coincide with the actions… You are a guest. You need to behave like a guest. | ethics | moral responsibility, respect for others’ rights, ethical integration behaviour |
| How to recognize a fake? Here are some simple tips… Pay attention to the headlines. Fake news is accompanied by loud headlines […] During the war, it is especially important to distinguish fakes from the truth. This deprives the enemy of the opportunity to sow demotivation and discord in society. | ethics | prevention of misinformation, protection of social cohesion, social responsibility |
| registration of a TIE (resident card). […] Again, you need to register online at Policia Nacional on the website. […] Bring with you the completed and signed EX 17 form. […] Again, they will print several fingers. […] passport or other identification document, application for temporary protection… pick up the resident card after 30–40 days… | legal | residence status registration, documentation procedures, access to legal residence rights |
| Starting from 29 June 2022, driver’s licenses issued in Ukraine will be recognized in Europe without any restrictions… This innovation allows Ukrainian drivers who have evacuated to the EU with their cars or intend to rent vehicles in other countries to drive in Europe without any obstacles. euEntry to Europe with Ukrainian license Ukrainians can use driver’s licenses | legal | recognition of Ukrainian documents, driving rights in host countries, access to mobility rights |
| Refugees in Poland can be forced to return aid !!Ukrainians who received temporary asylum in Poland must inform ZUS about their return home. If they leave without saying goodbye, they can be forced to return financial aid with interest. All aid is paid to Ukrainians, who are in Poland and do not leave the country for more than 30 days. If Ukrainians are going to return, they need to inform ZUS […] can report this through the Platform of Electronic Services (PUE) of the Social Insurance Office | legal | temporary asylum regulations, reporting requirements for refugees |
| ONLINE WORKSHOP ABOUT STRESS RELEASE Stress is a normal human reaction to extreme life circumstances… But what to do when stress does not disappear and becomes a chronic companion in your life? We invite you to a short workshop about 5 techniques for quick stress relief… During the workshop, you will learn: How can you normalize the psychological state through the body? Why is relaxation important… TRE® (Stress, Tension and Trauma release)? | social | emotional stress, psychological support, community support networks. |
| Humanitarian centre for refugees ““Global Expo”“ in Warsaw accepts Ukrainians who need help. Here you can get: free accommodation; free 3 meals a day; get the necessary clothes and shoes; get personal hygiene products; help from doctors, necessary medicines; help from a qualified psychologist; free legal assistance; children’s room for children; contests and entertainment for children… | social | practical everyday support access to healthcare, emotional stress, child-oriented community support |
| Good afternoon. Attention, REPOST! People with disabilities from Ukraine and their companions… are invited to the concert of the OE group on 27.11 free of charge. We can offer free and partial payment for the visit concerts under the following conditions: Person with disability group 1–2 from Ukraine—free of charge; Person with disability group 3 from Ukraine—50%… Accompanying person—50%… | social | social inclusion, disability inclusion |
| Social assistance to refugees in Belgium. To receive social assistance, you first need to register and obtain the status of a person in need… Payments in Belgium are monthly… They charge 1478 euros per family… Child benefits are paid separately. About 170 euros per child… If, prior to or during the payment of financial assistance, I receive a salary… this will be taken into account by the local authorities… | social | Belgian social assistance, financial assistance, child benefits. |
References
- Abkenar, Sepideh Bazzaz, Mostafa Haghi Kashani, Mohammad Akbari, and Ebrahim Mahdipour. 2023. Learning Textual Features for Twitter Spam Detection: A Systematic Literature Review. Expert Systems with Applications 228: 120366. [Google Scholar] [CrossRef]
- Ahmad Yar, Ahmad Wali, and Tuba Bircan. 2025. Challenges with International Migration Data: An Analysis of the Experience of National Statistical Institutions. International Migration Review 59: 1332–66. [Google Scholar] [CrossRef]
- Akata, Zeynep, Dan Balliet, Maarten de Rijke, Frank Dignum, Virginia Dignum, Guszti Eiben, Antske Fokkens, Davide Grossi, Koen Hindriks, Holger Hoos, and et al. 2020. A Research Agenda for Hybrid Intelligence: Augmenting Human Intellect with Collaborative, Adaptive, Responsible, and Explainable Artificial Intelligence. Computer 53: 18–28. [Google Scholar] [CrossRef]
- Arrieta, Alejandro Barredo, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garcia, Sergio Gil-Lopez, Daniel Molina, Richard Benjamins, and et al. 2020. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI. Information Fusion 58: 82–115. [Google Scholar] [CrossRef]
- Blank, Grant. 2017. The Digital Divide Among Twitter Users and Its Implications for Social Research. Social Science Computer Review 35: 679–97. [Google Scholar] [CrossRef]
- Bowker, Geoffrey C., and Susan Leigh Star. 2000. Sorting Things Out: Classification and Its Consequences. Cambridge: MIT Press. [Google Scholar]
- Cerina, Roberto, and Raymond M. Duch. 2026. Artificially Intelligent Opinion Polling. Royal Society Open Science 13: 251150. [Google Scholar] [CrossRef]
- Chiarello, Filippo, Vito Giordano, Irene Spada, Simone Barandoni, and Gualtiero Fantoni. 2024. Future Applications of Generative Large Language Models: A Data-Driven Case Study on ChatGPT. Technovation 133: 103002. [Google Scholar] [CrossRef]
- Chimbga, Bridget. 2023. Exploring the Ethical and Societal Concerns of Generative AI in Internet of Things (IoT) Environments. In Artificial Intelligence Research. Edited by Anban Pillay, Edgar Jembere and Aurona J. Gerber. Communications in Computer and Information Science. Cham: Springer Nature Switzerland, vol. 1976. [Google Scholar] [CrossRef]
- Dash, Niladri Sekhar, and L. Ramamoorthy. 2019. Utility and Application of Language Corpora. Singapore: Springer. [Google Scholar] [CrossRef]
- Dignum, Virginia, Matteo Baldoni, Christina Baroglio, Maurizio Caon, Raja Chatila, Louise Dennis, Gonzalo Génova, Galit Haim, Malte S. Kließ, Maite Lopez-Sanchez, and et al. 2018. Ethics by Design: Necessity or Curse? Paper presented at the 2018 AAAI/ACM Conference on AI, Ethics, and Society, New Orleans, LA, USA, February 2–3; pp. 60–66. [Google Scholar] [CrossRef]
- Du, Changde, Kaicheng Fu, Bincheng Wen, Yi Sun, Jie Peng, Wei Wei, Ying Gao, Shengpei Wang, Chuncheng Zhang, Jinpeng Li, and et al. 2025. Human-like Object Concept Representations Emerge Naturally in Multimodal Large Language Models. Nature Machine Intelligence 7: 860–75. [Google Scholar] [CrossRef]
- Fjeld, Jessica, Nele Achten, Hannah Hilligoss, Adam Nagy, and Madhulika Srikumar. 2020. Principled Artificial Intelligence: Mapping Consensus in Ethical and Rights-Based Approaches to Principles for AI. No. 2020–1. Cambridge: Berkman Klein Center Research Publication. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3518482 (accessed on 20 May 2025).
- Fort, Karën, Gilles Adda, and K. Bretonnel Cohen. 2011. Last Words: Amazon Mechanical Turk: Gold Mine or Coal Mine? Computational Linguistics 37: 413–20. [Google Scholar] [CrossRef]
- Fransen, Sonja, and Hein De Haas. 2022. Trends and Patterns of Global Refugee Migration. Population and Development Review 48: 97–128. [Google Scholar] [CrossRef] [PubMed]
- Ghallab, Malik. 2019. Responsible AI: Requirements and Challenges. AI Perspectives 1: 3. [Google Scholar] [CrossRef]
- Ghasiya, Piyush, and Kazutoshi Sasahara. 2023. Messaging Strategies of Ukraine and Russia on Telegram during the 2022 Russian Invasion of Ukraine. First Monday. Available online: https://firstmonday.org/ojs/index.php/fm/article/view/12873 (accessed on 14 March 2025).
- Gokcimen, Tunahan, and Bihter Das. 2024. Exploring Climate Change Discourse on Social Media and Blogs Using a Topic Modeling Analysis. Heliyon 10: e32464. Available online: https://www.cell.com/heliyon/fulltext/S2405-8440(24)08495-0 (accessed on 12 March 2025).
- Holzinger, Andreas. 2016. Interactive Machine Learning for Health Informatics: When Do We Need the Human-in-the-Loop? Brain Informatics 3: 119–31. [Google Scholar] [CrossRef]
- Iacus, Stefano M., Haodong Qi, and Jiyoung Han. 2025. Deep Literature Reviews: An Application of Fine-Tuned Language Models to Migration Research. arXiv. [Google Scholar] [CrossRef]
- Khairova, Nina, Arsenii Lukashevskyi, and Ivan Redozub. 2025. Ukrainian Migrants Telegram Discourse (2022–2023). Version 2. Geneva: Zenodo. [Google Scholar] [CrossRef]
- Khairova, Nina, Nina Rizun, Charalampos Alexopoulos, Magdalena Ciesielska, Arsenii Lukashevskyi, and Ivan Redozub. 2024. Understanding the Ukrainian Migrants Challenges in the EU: A Topic Modeling Approach. Paper presented at the 25th Annual International Conference on Digital Government Research, Taipei, Taiwan, June 11–14; pp. 196–205. [Google Scholar] [CrossRef]
- Krugmann, Jan Ole, and Jochen Hartmann. 2024. Sentiment Analysis in the Age of Generative AI. Customer Needs and Solutions 11: 3. [Google Scholar] [CrossRef]
- Kumari, Rabita. 2024. Shaping Societal Realities: The Dynamic Relationship between Language and Social Norms. International Journal of Cultural Studies and Social Sciences 20: 118–23. [Google Scholar]
- Leese, Matthias, Simon Noori, and Stephan Scheel. 2022. Data Matters: The Politics and Practices of Digital Border and Migration Management. Geopolitics 27: 5–25. [Google Scholar] [CrossRef]
- Li, Yihui, Yice Zhang, Yifan Yang, and Ruifeng Xu. 2023. A Generative Model for Structured Sentiment Analysis. In Artificial Intelligence and Mobile Services–AIMS 2023; Lecture Notes in Computer Science. Edited by Yujiu Yang, Xiaohui Wang and Liang-Jie Zhang. Cham: Springer Nature, vol. 14202. [Google Scholar] [CrossRef]
- Lutz, Christoph. 2022. Inequalities in Social Media Use and Their Implications for Digital Methods Research. In The SAGE Handbook of Social Media Research Methods. New York: SAGE Publications Ltd., pp. 679–90. [Google Scholar]
- Matwin, Stan, Aristides Milios, Paweł Prałat, Amilcar Soares, and François Théberge. 2023. Generative Methods for Social Media Analysis. Springer Briefs in Computer Science. Cham: Springer Nature. [Google Scholar] [CrossRef]
- Mendola, Daria, and Alessandra Pera. 2022. Vulnerability of Refugees: Some Reflections on Definitions and Measurement Practices. International Migration 60: 108–21. [Google Scholar] [CrossRef]
- Merrill, William, Yoav Goldberg, Roy Schwartz, and Noah A. Smith. 2021. Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand? Transactions of the Association for Computational Linguistics 9: 1047–60. [Google Scholar] [CrossRef]
- Mittelstadt, Brent Daniel, Patrick Allo, Mariarosaria Taddeo, Sandra Wachter, and Luciano Floridi. 2016. The Ethics of Algorithms: Mapping the Debate. Big Data & Society 3: 2053951716679679. [Google Scholar] [CrossRef]
- Navumau, Vasil, and Olga Matveieva. 2025. Telegram as a Lifeline and a Battlefield: A Socio-Informatics Study of Communication and Resistance Among Ukrainians in War. Paper presented at the 12th International Conference on Communities & Technologies (C&T 2025), Siegen, Germany, July 21–23; Available online: https://dl.eusset.eu/items/23b13c5c-cfd6-4eaa-8132-288182f3c406 (accessed on 14 January 2026).
- OECD. 2022. Building Trust to Reinforce Democracy: Main Findings from the 2021 Building Trust to Reinforce Democracy: Main Findings from the 2021 OECD Survey on Drivers of Trust in Public Institutions. In Building Trust in Public Institutions. Paris: OECD Publishing. [Google Scholar] [CrossRef]
- Ojo, Adegboyega, Nina Rizun, Grace Walsh, Mona Isazad Mashinchi, Maria Venosa, and Manohar Narayana Rao. 2024. Prioritising National Healthcare Service Issues from Free Text Feedback–A Computational Text Analysis & Predictive Modelling Approach. Decision Support Systems 181: 114215. [Google Scholar]
- Patel, Roma, and Ellie Pavlick. 2022. Mapping Language Models to Grounded Conceptual Spaces. International Conference on Learning Representations. Available online: https://openreview.net/forum?id=gJcEM8sxHK (accessed on 14 March 2025).
- Perin, Wagner de A., Davidsom Cury, Camila Zacché de Aguiar, and Crediné S. de Menezes. 2023. From Text to Maps: Automated Concept Map Generation Using Fine-Tuned Large Language Model. In Simpósio Brasileiro de Informática Na Educação (SBIE). pp. 1317–28. Available online: https://sol.sbc.org.br/index.php/sbie/article/view/26757 (accessed on 14 March 2025).
- Pisarevskaya, Asya, Nathan Levy, Peter Scholten, and Joost Jansen. 2020. Mapping Migration Studies: An Empirical Analysis of the Coming of Age of a Research Field. Migration Studies 8: 455–81. [Google Scholar] [CrossRef]
- Qian, Yuzhou, Keng L. Siau, and Fiona F. Nah. 2024. Societal Impacts of Artificial Intelligence: Ethical, Legal, and Governance Issues. Societal Impacts 3: 100040. [Google Scholar] [CrossRef]
- Reddick, Christopher G., Akemi Takeoka Chatfield, and Adegboyega Ojo. 2017. A Social Media Text Analytics Framework for Double-Loop Learning for Citizen-Centric Public Services: A Case Study of a Local Government Facebook Use. Government Information Quarterly 34: 110–25. [Google Scholar] [CrossRef]
- Redozub, Ivan, and Nina Khairova. 2025. Ukrainian Migrants: Official Sources Discourse (2022–2023). Geneva: Zenodo. [Google Scholar] [CrossRef]
- Sahin-Mencutek, Zeynep. 2020. Migration Narratives in Policy and Politics. Available online: https://www.researchgate.net/publication/346946202_Migration_Narratives_in_Policy_and_Politics (accessed on 18 May 2026).
- Schmidthuber, Lisa, Alex Ingrams, and Dennis Hilgers. 2021. Government Openness and Public Trust: The Mediating Role of Democratic Capacity. Public Administration Review 81: 91–109. [Google Scholar] [CrossRef]
- Scholten, Peter, ed. 2022. Introduction to Migration Studies: An Interactive Guide to the Literatures on Migration and Diversity. In IMISCOE Research Series. Cham: Springer International Publishing. [Google Scholar] [CrossRef]
- Teixeira, Sónia, Atia Cortés, Dilhan Thilakarathne, Gianmarco Gori, Marco Minici, Monowar Bhuyan, Nina Khairova, Tosin Adewumi, Devvjiit Bhuyan, Jack O’Keefe, and et al. 2025. A Multidimensional Approach to Ethical AI Auditing. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society 8: 2480–92. Available online: https://ojs.aaai.org/index.php/AIES/article/view/36732 (accessed on 14 January 2026). [CrossRef]
- Townsend, Leanne, and Claire Wallace. 2016. Social Media Research: A Guide to Ethics. University of Aberdeen 1: 1–16. [Google Scholar]
- United Nations High Commissioner for Refugees (UNHCR). 2024a. Effective Inclusion of Refugees: Participatory Approaches for Practitioners at the Local Level. UNHCR US, UNHCR. Available online: https://www.unhcr.org/us/effective-inclusion-refugees-participatory-approaches-practitioners-local-level (accessed on 14 March 2025).
- United Nations High Commissioner for Refugees (UNHCR). 2024b. Operational Data Portal: Ukraine Situation. Available online: https://data.unhcr.org/en/situations/ukraine (accessed on 14 March 2025).
- van Hilten, Mireille, Mark Ryan, Vincent Blok, and Nina de Roo. 2025. Ethical, Legal and Social Aspects (ELSA) for AI: An Assessment Tool for Agri-Food. Smart Agricultural Technology 10: 100710. [Google Scholar] [CrossRef]
- Vanmassenhove, Eva, Dimitar Shterionov, and Andy Way. 2019. Lost in Translation: Loss and Decay of Linguistic Richness in Machine Translation. In Proceedings of Machine Translation Summit XVII: Research Track. Dublin: European Association for Machine Translation, pp. 222–32. Available online: https://aclanthology.org/W19-6622.pdf (accessed on 20 March 2025).
- Wan, Mengting, Tara Safavi, Sujay Kumar Jauhar, Yujin Kim, Scott Counts, Jennifer Neville, Siddharth Suri, Chirag Shah, Ryen W. White, Longqi Yang, and et al. 2024. TnT-LLM: Text Mining at Scale with Large Language Models. Paper presented at the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Barcelona, Spain, August 25–29; pp. 5836–47. [Google Scholar] [CrossRef]
- Wang, Hongning, and Chengxiang Zhai. 2017. Generative Models for Sentiment Analysis and Opinion Mining. In A Practical Guide to Sentiment Analysis. Edited by Erik Cambria, Dipankar Das, Sivaji Bandyopadhyay and Antonio Feraco. Socio-Affective Computing. Berlin: Springer International Publishing, vol. 5. [Google Scholar] [CrossRef]
- Wei, Qinglan, Ruiqi Xue, Hongjiang Xiao, Yuan Zhang, Long Ye, and Yutian Wang. 2025. Mimicking the Mavens: Agent-Based Opinion Synthesis and Emotion Prediction for Social Media Influencers. Journal of Social Computing 6: 221–38. [Google Scholar] [CrossRef]
- Weidinger, Laura, Jonathan Uesato, Maribeth Rauh, Conor Griffin, Po-Sen Huang, John Mellor, Amelia Glaese, Myra Cheng, Borja Balle, Atoosa Kasirzadeh, and et al. 2022. Taxonomy of Risks Posed by Language Models. Paper presented at the 2022 ACM Conference on Fairness Accountability and Transparency, Seoul, Republic of Korea, June 21–24; pp. 214–29. [Google Scholar] [CrossRef]
- Willaert, Tom. 2023. A Computational Analysis of Telegram’s Narrative Affordances. PLoS ONE 18: e0293508. [Google Scholar] [CrossRef] [PubMed]
- Williams, Matthew L., Pete Burnap, Luke Sloan, Curtis Jessop, and Hayley Lepps. 2017. Users’ Views of Ethics in Social Media Research: Informed Consent, Anonymity, and Harm. Available online: https://www.emerald.com/books/edited-volume/15060/chapter-abstract/86216839 (accessed on 14 March 2025).
- Xu, Ningyu, Qi Zhang, Chao Du, Qiang Luo, Xipeng Qiu, Xuanjing Huang, and Menghan Zhang. 2025. Revealing Emergent Human-like Conceptual Representations from Language Prediction. Proceedings of the National Academy of Sciences 122: e2512514122. [Google Scholar] [CrossRef] [PubMed]
- Xu, Qihui, Yingying Peng, Samuel A. Nastase, Martin Chodorow, Minghua Wu, and Ping Li. 2025. Large Language Models without Grounding Recover Non-Sensorimotor but Not Sensorimotor Features of Human Concepts. Nature Human Behaviour 9: 1871–86. [Google Scholar] [CrossRef]



| Source of Documents | Source Details * | Number of Documents |
|---|---|---|
| International Organization for Migration | IOM Ukraine: Displacement Tracking Matrix | 234 |
| Government portals | UK, Polish, Spanish, Irish, Swedish, Italian, Czech Republic | 226 |
| Migration Agencies | German, US, Swedish, Moldovan, Czech, Canada | 53 |
| Ukraine Migration Services | State Migration Service of Ukraine | 51 |
| Foreign Ministries | Spanish, Slovak, Italian, Czech Republic | 49 |
| Ukrainian Embassies | Germany, Slovakia | 18 |
| Video Platform | YouTube | 39 |
| Social Media Platform | Twitter/X | 14 |
| Other | Czech, Slovak Education and Health Portals | 25 |
| Country | Dataset 1 | Dataset 2 | ||
|---|---|---|---|---|
| Official Texts (n) | Tokens (n) | Telegram Messages (n) | Tokens (n) | |
| Canada | 2 | 487 | 1473 | 233,233 |
| Czech | 61 | 23,270 | 173,607 | 6,754,443 |
| Germany | 28 | 91,246 | 235,737 | 1,862,742 |
| Ireland | 27 | 26,055 | 157,858 | 3,712,852 |
| Italy | 17 | 9403 | 169,560 | 421,089 |
| Moldova | 4 | 1098 | 63,122 | 1,682,927 |
| Poland | 67 | 24,670 | 235,108 | 5,739,128 |
| Slovakia | 11 | 2307 | 94,691 | 2,513,625 |
| Spain | 51 | 36,444 | 43,569 | 1,245,337 |
| Sweden | 20 | 15,924 | 139,560 | 3,225,243 |
| United Kingdom | 88 | 70,194 | 60,631 | 1,707,510 |
| USA | 10 | 6699 | 359,514 | 8,731,600 |
| Ukraine | 70 | 23,623 | - | - |
| IOM | 252 | 697,128 | ||
| Total | 708 | 1,028,548 | 1,734,430 | 37,829,729 |
| Ethics | Legal | Social |
|---|---|---|
| morality principles, decision-making responsibility, social norms agreements, professional ethics, ethical dilemmas | rules and regulations, enforcement authority protection of rights, legal system adaptability, interpretation and application | social interactions, social norms, social institutions, socialisation, social change, social stratification |
| Taxonomy Dimensions | First Step | Duplicates Deleting | Manual Adjustment | Final Number of Concepts/Top Level |
|---|---|---|---|---|
| Ethics | 250 | 165 (85 deleted) | 77 (88 deleted) | 77/7 |
| Legal | 400 | 324 (76 deleted) | 145 (179 deleted) | 145/8 |
| Social | 450 | 350 (100 deleted) | 228 (122 deleted) | 228/4 |
| Ethics | Legal | Social |
|---|---|---|
| Migration status and intentions | International Law and Frameworks | Migration and Social Structures |
| Ethical Considerations | European Union Migration Framework | Migration and Economic Factors |
| Migration and Emotional Impacts | National Migration Policies and Laws | Migration and Social Change |
| Research Ethics | Migration Control and Enforcement | Migration and Individual Factors |
| Migration Policies | Migration Types and Categories | |
| Human Rights and Social Justice | Migration Governance and Policy | |
| Migration Research Methodologies | Regional and National Bodies | |
| Research, Advocacy, and Public Discourses |
| Dataset | Three Phases (Initial/Constraint-Based/Taxonomy-Informed) | ||
|---|---|---|---|
| Ethics (%) | Legal (%) | Social (%) | |
| Dataset 1: Official documents | 0/<1/0.3 | 16/25.5/32.7 | 72/70/66.3 |
| Dataset 2: Telegram texts | 1/<1/0.3 | 15/21.5/22.8 | 64/68/75 |
| Official Documents (Dataset 1) | Expert Label | Model Label |
|---|---|---|
| …The aim of the project is to provide support for the functioning of national asylum and migration management systems * by increasing the efficiency of activities in the area of voluntary returns. On the one hand, raising knowledge on the mechanism of voluntary return… * | social | legal |
| You have the right to work when you receive a temporary protection permit in accordance with the Temporary Protection Directive. Your children have the right to go to school, and you are entitled to health care as soon as you submit a defense application in accordance with the Temporary Protection Directive. The right to work. A person who is 16 years old is entitled to work after receiving a residence permit with protection in accordance with the Temporary Protection Directive…You or your employer must submit an application for a pre-employee income tax (A-Skatt) to the Skatteverket… | legal | legal |
| …Because we have monitored and understand how many our citizens need documentation according to passports, this is first and foremost what is very pleased. The fact that they simultaneously design our citizens, at the same time draw these cards. This means that they do not lose this sacred connection with Ukraine. We also expand the range of services we provide with the Ministry of Internal Affairs of Ukraine. It is an exchange of driver’s licenses… | legal | legal |
| Telegram Messages (Dataset 2) ** | Expert Label | Model Label |
| Spain provides temporary protection to Ukrainians until 4 March 2024. What you will receive: The right to legal residence in Spain (until 4 March 2024). The right to work in Spain. The right to free state medical care in Spain Free housing is NOT PROVIDED!!… Language courses—are free for Ukrainians, you look for it yourself. !! That is, you need to rely only on yourself and your financial capabilities. !! What they write about programs is from organizations such as the Red Cross and others. They provide shelter (without animals) and food… | social | legal |
| How to get an electronic copy of your diploma If you forgot or were unable to take all the necessary documents and were forced to leave your homes, you can read the instructions on how to independently get an electronic version of your higher education diploma… | social | legal |
| Vacancy Free Responsibilities: sewing car seats and completing …Accommodation: • provided by the employer FREE OF CHARGE • … We guarantee: • Official employment in accordance with Czech legislation • Timely payment of wages (to a card or cash) • Weekly advances of 1000–1500 CZK • Payment of all state taxes for the employee • Free processing of all employee documents necessary for employment • Assistance and consultation in processing tolerance visas… | social | social |
| Dataset 1 (%) | Dataset 2 (%) | |||
|---|---|---|---|---|
| 2022 | 2023–February 2024 | 2022 | 2023–February 2024 | |
| Social | 69.0 | 62.3 | 75.4 | 74.5 |
| Legal | 29.4 | 37.7 | 23.6 | 21.9 |
| Ethics | 0.5 | <1 | <1 | <1 |
| Other | 1.2 | <1 | 0.8 | 3.0 |
| IT | MD | PL | SK | SP | SE | UK | IR | DE | CZ | CA | USA | Average | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Social | 77.4 | 77.9 | 76 | 71.6 | 75.7 | 69.5 | 77.7 | 83.2 | 72.3 | 86.5 | 70 | 62.8 | 75 |
| Legal | 20.7 | 20.8 | 23 | 27.4 | 23.6 | 30 | 20.9 | 15.8 | 25.8 | 12.5 | 28.5 | 24.5 | 22.8 |
| Ethics | 0.2 | 0.3 | 0.2 | 0.2 | 0.2 | 0 | 0.2 | 0.5 | 0.2 | 0.1 | 0.1 | 1.5 | 0.3 |
| Other | 1.7 | 1 | 1.1 | 0.8 | 0.5 | 0.5 | 1.2 | 0.5 | 1.7 | 0.9 | 1.4 | 11,.2 | 1.9 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Khairova, N.; Redozub, I.; Dignum, V.; Rizun, N. Evaluating Generative AI for Identifying Ethical, Legal, and Social Dimensions in Migration Narratives: A Case Study of Ukrainian Discourse. Soc. Sci. 2026, 15, 341. https://doi.org/10.3390/socsci15060341
Khairova N, Redozub I, Dignum V, Rizun N. Evaluating Generative AI for Identifying Ethical, Legal, and Social Dimensions in Migration Narratives: A Case Study of Ukrainian Discourse. Social Sciences. 2026; 15(6):341. https://doi.org/10.3390/socsci15060341
Chicago/Turabian StyleKhairova, Nina, Ivan Redozub, Virginia Dignum, and Nina Rizun. 2026. "Evaluating Generative AI for Identifying Ethical, Legal, and Social Dimensions in Migration Narratives: A Case Study of Ukrainian Discourse" Social Sciences 15, no. 6: 341. https://doi.org/10.3390/socsci15060341
APA StyleKhairova, N., Redozub, I., Dignum, V., & Rizun, N. (2026). Evaluating Generative AI for Identifying Ethical, Legal, and Social Dimensions in Migration Narratives: A Case Study of Ukrainian Discourse. Social Sciences, 15(6), 341. https://doi.org/10.3390/socsci15060341

