Skip to Content

512 Results Found

  • Article
  • Open Access
3 Citations
2,818 Views
23 Pages

28 March 2026

The detection of corruption-related indicators within unstructured, textual procurement data remains a complex task due to linguistic ambiguity, contextual variation and domain-specific terminology. This study presents a comparative evaluation of thr...

(This article belongs to the Collection Natural Language Processing and Applications: Challenges and Perspectives)
  • Article
  • Open Access
1 Citations
782 Views
25 Pages

8 August 2026

Environmental, Social, and Governance (ESG) risks increasingly propagate across interconnected supply chains, yet conventional ESG assessment methods remain largely reliant on firm-level disclosures and static ESG ratings that often overlook indirect...

(This article belongs to the Special Issue AI × DeFi × Sustainability: Redesigning the Operating System of Global Finance)
  • Review
  • Open Access
187 Citations
39,511 Views
57 Pages

5 January 2023

Transformer architectures are highly expressive because they use self-attention mechanisms to encode long-range dependencies in the input sequences. In this paper, we present a literature review on Transformer-based (TB) models, providing a detailed...

(This article belongs to the Special Issue Feature Papers for AI)
  • Article
  • Open Access
919 Views
44 Pages

3 July 2026

Construction contracts are vital for governing responsibilities in large-scale infrastructure projects, but their increasing complexity often leads to interpretation difficulties, disputes, and delays. Despite advances in natural language processing...

  • Review
  • Open Access
  • Best Paper Award
237 Citations
35,890 Views
17 Pages

Transformers in the Real World: A Survey on NLP Applications

  • Narendra Patwardhan,
  • Stefano Marrone and
  • Carlo Sansone

17 April 2023

The field of Natural Language Processing (NLP) has undergone a significant transformation with the introduction of Transformers. From the first introduction of this technology in 2017, the use of transformers has become widespread and has had a profo...

(This article belongs to the Collection Natural Language Processing and Applications: Challenges and Perspectives)
  • Article
  • Open Access
6 Citations
5,000 Views
37 Pages

29 September 2020

Model-to-model (M2M) transformations are among the key components of model-driven development, enabling a certain level of automation in the process of developing models. The developed solution of using drag-and-drop actions-based M2M transformations...

(This article belongs to the Special Issue Model-Based Systems Engineering: Rigorous Foundations for Digital Transformations in Science and Engineering)
  • Review
  • Open Access
2,725 Views
25 Pages

Autoencoder-based models have become a fundamental component of unsupervised and self-supervised learning in natural language processing (NLP), enabling models to learn compact latent representations through input reconstruction. From early denoising...

  • Article
  • Open Access
10 Citations
4,292 Views
27 Pages

19 June 2024

The research presented in the following paper focuses on the effectiveness of a modern standard Arabic corpus, AraFast, in training transformer models for natural language processing tasks, particularly in Arabic. In the study described herein, four...

(This article belongs to the Special Issue Natural Language Processing: Theory, Methods and Applications)
  • Article
  • Open Access
15 Citations
4,180 Views
16 Pages

The increasing use of electronic health records (EHRs) generates a vast amount of data, which can be leveraged for predictive modeling and improving patient outcomes. However, EHR data are typically mixtures of structured and unstructured data, which...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
53 Citations
10,140 Views
16 Pages

Transformer-Based Graph Convolutional Network for Sentiment Analysis

  • Barakat AlBadani,
  • Ronghua Shi,
  • Jian Dong,
  • Raeed Al-Sabri and
  • Oloulade Babatounde Moctard

26 January 2022

Sentiment Analysis is an essential research topic in the field of natural language processing (NLP) and has attracted the attention of many researchers in the last few years. Recently, deep neural network (DNN) models have been used for sentiment ana...

(This article belongs to the Special Issue Natural Language Processing: Approaches and Applications)
  • Article
  • Open Access
5 Citations
5,011 Views
26 Pages

Developing a Hybrid Morphological Analyzer for Low-Resource Languages

  • Musica Supriya,
  • Dinesh Acharya Udupi,
  • Ashalatha Nayak and
  • Arjuna Srirangapatna Raghavendra

19 May 2025

Morphological analysis is the fundamental and preliminary task for Natural Language Processing (NLP) applications, which involve speech and language. Kannada is a low-resource language belonging to the Dravidian language family, which is highly agglu...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
11 Citations
3,806 Views
30 Pages

DeB3RTa: A Transformer-Based Model for the Portuguese Financial Domain

  • Higo Pires,
  • Leonardo Paucar and
  • Joao Paulo Carvalho

The complex and specialized terminology of financial language in Portuguese-speaking markets create significant challenges for natural language processing (NLP) applications, which must capture nuanced linguistic and contextual information to support...

  • Article
  • Open Access
10 Citations
3,447 Views
33 Pages

Hybrid Transformer-Based Large Language Models for Word Sense Disambiguation in the Low-Resource Sesotho sa Leboa Language

  • Hlaudi Daniel Masethe,
  • Mosima Anna Masethe,
  • Sunday O. Ojo,
  • Pius A. Owolawi and
  • Fausto Giunchiglia

25 March 2025

This study addresses a lexical ambiguity issue in Sesotho sa Leboa that arises from terms with various meanings, often known as homonyms or polysemous words. When compared to, for instance, European languages, this lexical ambiguity in Sesotho sa Leb...

(This article belongs to the Special Issue Advances in Large Language Models: Techniques, Applications and Challenges)
  • Article
  • Open Access
10 Citations
3,338 Views
22 Pages

17 April 2024

Green energy refers to energy derived from renewable sources such as solar, wind, hydro, and biomass, which are environmentally sustainable. It aims to reduce reliance on fossil fuels and mitigate environmental impacts. In the Turkish context, alongs...

  • Article
  • Open Access
28 Citations
12,316 Views
14 Pages

Part-of-Speech (POS) tagging is one of the most important tasks in the field of natural language processing (NLP). POS tagging for a word depends not only on the word itself but also on its position, its surrounding words, and their POS tags. POS tag...

(This article belongs to the Section Artificial Intelligence)
  • Review
  • Open Access
31 Citations
6,244 Views
30 Pages

Contemporary Approaches in Evolving Language Models

  • Dina Oralbekova,
  • Orken Mamyrbayev,
  • Mohamed Othman,
  • Dinara Kassymova and
  • Kuralai Mukhsina

1 December 2023

This article provides a comprehensive survey of contemporary language modeling approaches within the realm of natural language processing (NLP) tasks. This paper conducts an analytical exploration of diverse methodologies employed in the creation of...

(This article belongs to the Special Issue Natural Language Processing: Trends and Challenges)
  • Article
  • Open Access
9 Citations
4,064 Views
33 Pages

An Effective Med-VQA Method Using a Transformer with Weights Fusion of Multiple Fine-Tuned Models

  • Suheer Al-Hadhrami,
  • Mohamed El Bachir Menai,
  • Saad Al-Ahmadi and
  • Ahmad Alnafessah

28 August 2023

Visual question answering (VQA) is a task that generates or predicts an answer to a question in human language about visual images. VQA is an active field combining two AI branches: NLP and computer vision. VQA in the medical field is still at an ear...

  • Article
  • Open Access
1 Citations
978 Views
17 Pages

Semantic Analysis of Technical Documentation: Systematic Review, Formal Task Definition, and Transformer-Based NER Implementation

  • Alexander Echin,
  • Alla G. Kravets,
  • Elena Safonova,
  • Dmitry A. Skorobogatchenko and
  • Danila Karasev

The increasing complexity and volume of technical documentation, including requirements specifications, patents, and engineering reports, create significant challenges for manual analysis and knowledge extraction. This paper includes a systematic rev...

(This article belongs to the Section Data Mining and Machine Learning)
  • Review
  • Open Access
91 Citations
17,223 Views
23 Pages

Ensemble Large Language Models: A Survey

  • Ibomoiye Domor Mienye and
  • Theo G. Swart

13 August 2025

Large language models (LLMs) have transformed the field of natural language processing (NLP), achieving state-of-the-art performance in tasks such as translation, summarization, and reasoning. Despite their impressive capabilities, challenges persist...

  • Article
  • Open Access
513 Views
27 Pages

2 September 2026

Arabic remains underrepresented in many task-specific natural language processing (NLP) resources and benchmarks, particularly for specialized user interface (UI) understanding tasks. In mobile commerce, Arabic UI text may contain persuasive or decep...

(This article belongs to the Special Issue Low-Resource Languages in the Age of Large Language Models)
  • Article
  • Open Access
7 Citations
4,441 Views
12 Pages

24 January 2025

Background: Large language models (LLMs) have seen a significant boost recently in the field of natural language processing (NLP) due to their capabilities in analyzing words. These autoregressive models prove robust in classification tasks where tex...

(This article belongs to the Section Methodology, Drug and Device Discovery)
  • Article
  • Open Access
1 Citations
1,489 Views
33 Pages

A Multi-Stage NLP Framework for Knowledge Discovery from Crop Disease Research Literature

  • Jantima Polpinij,
  • Manasawee Kaenampornpan,
  • Christopher S. G. Khoo,
  • Wei-Ning Cheng and
  • Bancha Luaphol

14 January 2026

Extracting and organizing knowledge from the agricultural crop disease research literature are challenging tasks because of the heterogeneous terminologies, complicated symptom descriptions, and unstructured nature of scientific documents. In this st...

(This article belongs to the Special Issue Research on Machine Learning, Data Mining, Natural Language Processes, and Optimization Methods)
  • Article
  • Open Access
5 Citations
4,346 Views
26 Pages

Text classification remains a challenging task in natural language processing (NLP) due to linguistic complexity and data imbalance. This study proposes a hybrid approach that integrates grammar-based feature engineering with deep learning and transf...

(This article belongs to the Special Issue Recent Advances in Social Media Mining and Analysis)
  • Article
  • Open Access
7 Citations
3,225 Views
18 Pages

Social Media Topic Classification on Greek Reddit

  • Charalampos Mastrokostas,
  • Nikolaos Giarelis and
  • Nikos Karacapilidis

26 August 2024

Text classification (TC) is a subtask of natural language processing (NLP) that categorizes text pieces into predefined classes based on their textual content and thematic aspects. This process typically includes the training of a Machine Learning (M...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
2 Citations
1,309 Views
29 Pages

A Transformer-Based Method for Bidirectional French–Lingala Machine Translation in Speech and Text

  • Reagan E. Mandiya,
  • Selain K. Kasereka,
  • Christophe B. Wizamo,
  • Milena Savova-Mratsenkova and ,
  • Ruffin-Benoît M. Ngoie,
  • Tasho Tashev and
  • Nathanaël M. Kasoro
  • + 2 authors+ 0 author

31 March 2026

Underrepresented languages such as Lingala are a significant part of the world’s cultural and linguistic heritage. Lingala plays a central role in daily communication, business, media, education, and culture for millions of people in the Democr...

(This article belongs to the Special Issue The Advanced Trends in Natural Language Processing)
  • Article
  • Open Access
20 Citations
11,884 Views
32 Pages

6 June 2022

The development of intelligent information technology in the era of the fourth industrial revolution requires the EPC (engineering, procurement, and construction) industry to increase productivity through a digital transformation. This study aims to...

(This article belongs to the Section Green Building)
  • Review
  • Open Access
52 Citations
14,558 Views
28 Pages

From Traditional Recommender Systems to GPT-Based Chatbots: A Survey of Recent Developments and Future Directions

  • Tamim Mahmud Al-Hasan,
  • Aya Nabil Sayed,
  • Faycal Bensaali,
  • Yassine Himeur and ,
  • Iraklis Varlamis and
  • George Dimitrakopoulos
  • + 1 author+ 0 author

Recommender systems are a key technology for many applications, such as e-commerce, streaming media, and social media. Traditional recommender systems rely on collaborative filtering or content-based filtering to make recommendations. However, these...

(This article belongs to the Special Issue Artificial Intelligence and Natural Language Processing)
  • Article
  • Open Access
1 Citations
725 Views
21 Pages

Integrating Thesaurus-Based Knowledge into Transformer Models for Semantic Understanding of Domain-Specific Texts

  • Bayangali Abdygalym,
  • Saule Tazhibayeva,
  • Madina Sambetbayeva,
  • Aigerim Yerimbetova and ,
  • Roman Taberkhan,
  • Manzura Abjalova,
  • Aidos Sabdenov and
  • Elmira Daiyrbayeva
  • + 3 authors+ 0 author

Integrating structured linguistic resources into deep learning architectures represents a key challenge in domain-oriented NLP. This study proposes a framework for incorporating knowledge from a military thesaurus of the Ground Forces, structured acc...

  • Article
  • Open Access
1,491 Views
25 Pages

AI-Enabled Management of Transfer Pricing Documentation: A Sustainable Governance Framework Integrating Compliance, Digitalization, and CSRD Requirements

  • Marius Boiță,
  • Florin Cornel Dumiter,
  • Erika Loučanová,
  • Luminița Păiușan and ,
  • Gheorghe Pribeanu and
  • Ionela Mihaela Milutin
  • + 1 author+ 0 author

5 March 2026

Tax administrations are undergoing rapid digitalisation, while sustainability requirements are increasingly embedded in corporate governance frameworks. These parallel transformations are raising new expectations for transfer pricing (TP) documentati...

(This article belongs to the Section Sustainable Management)
  • Article
  • Open Access
353 Views
35 Pages

16 September 2026

Rapid release cycles and user-centric design have transformed requirement engineering into a continuous process within software development. Analyzing user-generated feedback from diverse online platforms is essential for feature prioritization. Whil...

(This article belongs to the Special Issue Advances in Data-Driven Artificial Intelligence, 2nd Edition)
  • Article
  • Open Access
98 Citations
35,920 Views
26 Pages

15 October 2023

Email phishing is a widespread cyber threat that can result in the theft of sensitive information and financial loss. It uses malicious emails to trick recipients into providing sensitive information or transferring money, often by disguising themsel...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
27 Citations
7,227 Views
21 Pages

Sarcasm detection is a crucial task in natural language processing (NLP), particularly in sentiment analysis and opinion mining, where sarcasm can distort sentiment interpretation. Accurately identifying sarcasm remains challenging due to its context...

(This article belongs to the Special Issue Natural Language Processing (NLP) and Large Language Modelling)
  • Review
  • Open Access
1,242 Views
22 Pages

18 February 2026

The inference of unstructured text semantics is a crucial preprocessing task for NLP and AI applications. Word sense disambiguation and entity linking tasks resolve ambiguous terms within unstructured text corpora to senses from a predefined knowledg...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
2 Citations
1,458 Views
20 Pages

The rise of Online Social Networks has reshaped global discourse, enabling real-time conversations on complex issues such as irregular migration. Yet the informal, multilingual, and often noisy nature of content on platforms like X (formerly Twitter)...

(This article belongs to the Special Issue Artificial Intelligence-Driven Emerging Applications)
  • Article
  • Open Access
13 Citations
4,112 Views
17 Pages

Extracting Semantic Relationships in Greek Literary Texts

  • Despina Christou and
  • Grigorios Tsoumakas

21 August 2021

In the era of Big Data, the digitization of texts and the advancements in Artificial Intelligence (AI) and Natural Language Processing (NLP) are enabling the automatic analysis of literary works, allowing us to delve into the structure of artifacts a...

(This article belongs to the Special Issue Cultural Heritage Storytelling, Engagement and Management in the Era of Big Data and the Semantic Web)
  • Article
  • Open Access
17 Citations
4,551 Views
25 Pages

Natural Language Processing in Diagnostic Texts from Nephropathology

  • Maximilian Legnar,
  • Philipp Daumke,
  • Jürgen Hesser,
  • Stefan Porubsky and ,
  • Zoran Popovic,
  • Jan Niklas Bindzus,
  • Joern-Helge Heinrich Siemoneit and
  • Cleo-Aron Weis
  • + 3 authors+ 0 author

Introduction: This study investigates whether it is possible to predict a final diagnosis based on a written nephropathological description—as a surrogate for image analysis—using various NLP methods. Methods: For this work, 1107 unlabell...

(This article belongs to the Special Issue Artificial Intelligence in Pathological Image Analysis)
  • Article
  • Open Access
2 Citations
762 Views
15 Pages

12 June 2026

This study evaluates zero-shot domain transfer for multilingual sentiment analysis in sustainable urban mobility using XLM-RoBERTa, a transformer pre-trained on social media data and applied to transport reviews without task- or domain-specific fine-...

(This article belongs to the Section AI Systems: Theory and Applications)
  • Article
  • Open Access
3 Citations
4,064 Views
21 Pages

Comparative Analysis of BERT and GPT for Classifying Crisis News with Sudan Conflict as an Example

  • Yahya Masri,
  • Zifu Wang,
  • Anusha Srirenganathan Malarvizhi,
  • Samir Ahmed and ,
  • Tayven Stover,
  • David W. S. Wong,
  • Yongyao Jiang,
  • Yun Li,
  • Qian Liu and
  • Chaowei Yang
  • + 8 authors+ 3 authors

8 July 2025

To obtain actionable information for humanitarian and other emergency responses, an accurate classification of news or events is critical. Daily news and social media are hard to classify based on conveyed information, especially when multiple catego...

(This article belongs to the Special Issue Evolution of Algorithms in the Era of Generative AI)
  • Article
  • Open Access
14 Citations
6,620 Views
19 Pages

The rapid increase in scientific publications has made it challenging to keep up with the latest advancements. Conducting systematic reviews using traditional methods is both time-consuming and difficult. To address this, new review formats like rapi...

(This article belongs to the Special Issue Advances in Natural Language Processing and Text Mining)
  • Article
  • Open Access
80 Citations
12,924 Views
19 Pages

Emotion Detection for Social Robots Based on NLP Transformers and an Emotion Ontology

  • Wilfredo Graterol,
  • Jose Diaz-Amado,
  • Yudith Cardinale,
  • Irvin Dongo and ,
  • Edmundo Lopes-Silva and
  • Cleia Santos-Libarino
  • + 1 author+ 0 author

13 February 2021

For social robots, knowledge regarding human emotional states is an essential part of adapting their behavior or associating emotions to other entities. Robots gather the information from which emotion detection is processed via different media, such...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
46 Citations
9,445 Views
28 Pages

Agile Methodology for the Standardization of Engineering Requirements Using Large Language Models

  • Archana Tikayat Ray,
  • Bjorn F. Cole,
  • Olivia J. Pinon Fischer,
  • Anirudh Prabhakara Bhat and ,
  • Ryan T. White and
  • Dimitri N. Mavris
  • + 1 author+ 0 author

10 July 2023

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and, in particular, a shift toward Model-Based Systems Engineering (MBSE) approaches for system design. The requiremen...

(This article belongs to the Section Systems Engineering)
  • Article
  • Open Access
7 Citations
4,302 Views
36 Pages

Social media is crucial for gathering public feedback on government services, particularly in the traffic sector. While Aspect-Based Sentiment Analysis (ABSA) offers a means to extract actionable insights from user posts, analyzing Arabic content pos...

  • Article
  • Open Access
3 Citations
1,541 Views
22 Pages

The proliferation of digital financial news offers unprecedented opportunities for automated analysis of market-moving events. This paper presents a framework for event-based sentiment analysis of financial news that leverages Large Language Models (...

(This article belongs to the Special Issue Artificial Intelligence, Generative AI and Large Language Models: Transforming Technology and Society)
  • Article
  • Open Access
548 Views
23 Pages

Transformer-Based Clinical Annotation of Lung Cancer Reports: A Benchmark and Fine-Tuning Study on a Novel Tunisian Corpus

  • Ranim Yahyaoui,
  • Ismail Dergaa,
  • Jean Noël Nikiema,
  • Halil İbrahim Ceylan and ,
  • Nicola Luigi Bragazzi,
  • Saoussen Hantous-Zannad and
  • Hanene Boussi Rahmouni
  • + 2 authors+ 0 author

Background: Lung cancer causes more deaths than any other malignancy worldwide, accounting for 2.2 million new cases and 1.8 million deaths in 2020. Extracting structured clinical knowledge from unstructured French-language oncology records remains m...

(This article belongs to the Special Issue Biomedical Data Mining: Emerging Methods and Applications)
  • Article
  • Open Access
4 Citations
4,401 Views
21 Pages

A Multi-Head Attention-Based Transformer Model for Predicting Causes in Aviation Incidents

  • Aziida Nanyonga,
  • Hassan Wasswa,
  • Keith Joiner,
  • Ugur Turhan and
  • Graham Wild

The timely identification of probable causes in aviation incidents is crucial for averting future tragedies and safeguarding passengers. Typically, investigators rely on flight data recorders; however, delays in data retrieval or damage to the device...

  • Article
  • Open Access
36 Citations
7,967 Views
24 Pages

nBERT: Harnessing NLP for Emotion Recognition in Psychotherapy to Transform Mental Health Care

  • Abdur Rasool,
  • Saba Aslam,
  • Naeem Hussain,
  • Sharjeel Imtiaz and
  • Waqar Riaz

9 April 2025

The rising prevalence of mental health disorders, particularly depression, highlights the need for improved approaches in therapeutic interventions. Traditional psychotherapy relies on subjective assessments, which can vary across therapists and sess...

(This article belongs to the Collection Natural Language Processing and Applications: Challenges and Perspectives)
  • Article
  • Open Access
892 Views
21 Pages

This study investigates multi-label movie genre prediction from user-written reviews in which textual content is inherently subjective and the movies reviewed naturally belong to multiple genres. To address extreme class imbalance and label sparsity...

  • Article
  • Open Access
1 Citations
605 Views
24 Pages

17 June 2026

Detecting trafficking-related indicators in online advertisements remains a challenging natural language processing task due to ambiguous language, repetitive templates, and evolving euphemistic expressions. This study presents a lightweight transfor...

(This article belongs to the Section Information Applications)
  • Article
  • Open Access
688 Views
30 Pages

21 August 2026

Automated extraction of structured threat information from unstructured cyber threat intelligence (CTI) underpins modern security operations, yet the supporting machine learning resources are almost exclusively English: no annotated Arabic CTI named...

(This article belongs to the Special Issue AI in Cybersecurity, 3rd Edition)
  • Article
  • Open Access
10 Citations
5,153 Views
31 Pages

20 April 2024

In the evolving field of machine learning, deploying fair and transparent models remains a formidable challenge. This study builds on earlier research, demonstrating that neural architectures exhibit inherent biases by analyzing a broad spectrum of t...

(This article belongs to the Section Computing and Artificial Intelligence)

of 11