Skip to Content

23,787 Results Found

  • Systematic Review
  • Open Access
2 Citations
1,425 Views
32 Pages

A Systematic Review of Transformer-Based Models for Depression Detection

  • Shiwen Zhou,
  • Masnizah Mohd and
  • Lailatul Qadri Zakaria

18 May 2026

Depression is a critical global public health challenge, and the demand for accurate automated detection methods has generated considerable research interest in Transformer-based models. Despite their substantial promise, a comprehensive investigatio...

  • Review
  • Open Access
11 Citations
2,175 Views
25 Pages

9 September 2025

The rapid growth of digital content in Urdu has created an urgent need for effective automatic text summarization (ATS) systems. While extractive methods have been widely studied, abstractive summarization for Urdu remains largely unexplored due to t...

(This article belongs to the Special Issue Natural Language Processing (NLP) with Applications and Natural Language Understanding (NLU))
  • Review
  • Open Access
1 Citations
898 Views
23 Pages

22 July 2026

Background/Objectives: This scoping review examined recent evidence on the use of transformer-based language models, encompassing encoder-only architectures (e.g., BERT and its clinical variants) and generative large language models (LLMs; e.g., GPT-...

(This article belongs to the Special Issue Artificial Intelligence-Based Digital Health Emerging Technologies)
  • Article
  • Open Access
2 Citations
1,467 Views
20 Pages

The rise of Online Social Networks has reshaped global discourse, enabling real-time conversations on complex issues such as irregular migration. Yet the informal, multilingual, and often noisy nature of content on platforms like X (formerly Twitter)...

(This article belongs to the Special Issue Artificial Intelligence-Driven Emerging Applications)
  • Article
  • Open Access
1 Citations
1,186 Views
17 Pages

25 November 2025

In the current information age, with the exponential growth of data volume and language-based applications, the accurate resolution of intra-contextual relationships in texts has become indispensable for both academic research and industrial Natural...

(This article belongs to the Special Issue Practical Applications of Large Language Models in Natural Language Processing)
  • Article
  • Open Access
1 Citations
1,420 Views
24 Pages

An Adaptive Transformer-Based Language-Model Framework for Assessing Urban Expansion

  • Fang Wan,
  • Zhan Zhang,
  • Ru Wang,
  • Daoyu Shu and ,
  • Beile Ning,
  • Jianya Gong and
  • Xi Li
  • + 2 authors+ 0 author

23 March 2026

Urban expansion is a key driver of land-use change and environmental pressure in rapidly urbanizing regions. Existing assessments of urban expansion often rely on predefined indicator systems and fixed weighting schemes, which limits their adaptabili...

(This article belongs to the Special Issue Monitoring and Modelling Human–Environment Interactions in Urban–Rural Areas)
  • Article
  • Open Access
18 Citations
4,157 Views
18 Pages

16 November 2023

Sea surface temperature (SST) is one of the most important factors related to the ocean and the climate. In studying the domains of eddies, fronts, and current systems, high-resolution SST data are required. However, the passive microwave radiometer...

(This article belongs to the Topic Deep Learning and Transformers’ Methods Applied to Remotely Captured Data)
  • Article
  • Open Access
12 Citations
3,828 Views
30 Pages

DeB3RTa: A Transformer-Based Model for the Portuguese Financial Domain

  • Higo Pires,
  • Leonardo Paucar and
  • Joao Paulo Carvalho

The complex and specialized terminology of financial language in Portuguese-speaking markets create significant challenges for natural language processing (NLP) applications, which must capture nuanced linguistic and contextual information to support...

  • Article
  • Open Access
1 Citations
1,727 Views
31 Pages

31 December 2025

Semantic segmentation of crowdsourced street-level imagery plays a critical role in urban analytics by enabling pixel-wise understanding of urban scenes for applications such as walkability scoring, environmental comfort evaluation, and urban plannin...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
16 Citations
6,092 Views
23 Pages

The generation and prediction of daily human mobility patterns have raised significant interest in many scientific disciplines. Using various data sources, previous studies have examined several deep learning frameworks, such as the RNN and GAN, to s...

(This article belongs to the Special Issue Advances in AI-Driven Geospatial Analysis and Data Generation)
  • Article
  • Open Access
68 Citations
7,224 Views
20 Pages

Explainable Transformer-Based Deep Learning Model for the Detection of Malaria Parasites from Blood Cell Images

  • Md. Robiul Islam,
  • Md. Nahiduzzaman,
  • Md. Omaer Faruq Goni,
  • Abu Sayeed and ,
  • Md. Shamim Anower,
  • Mominul Ahsan and
  • Julfikar Haider
  • + 2 authors+ 0 author

8 June 2022

Malaria is a life-threatening disease caused by female anopheles mosquito bites. Various plasmodium parasites spread in the victim’s blood cells and keep their life in a critical situation. If not treated at the early stage, malaria can cause e...

(This article belongs to the Special Issue Deep Learning for Pathology Detection and Diagnosis in Medical Imaging)
  • Article
  • Open Access
8 Citations
2,744 Views
24 Pages

Research on Coal and Gas Outburst Prediction and Sensitivity Analysis Based on an Interpretable Ali Baba and the Forty Thieves–Transformer–Support Vector Machine Model

  • Yanping Wang,
  • Zhixin Qin,
  • Zhenguo Yan,
  • Jun Deng and ,
  • Yuxin Huang,
  • Longcheng Zhang,
  • Yuqi Cao and
  • Yiyang Wang
  • + 3 authors+ 0 author

22 January 2025

Coal and gas outbursts pose significant threats to underground personnel, making the development of accurate prediction models crucial for reducing casualties. By addressing the challenges of highly nonlinear relationships among predictive parameters...

(This article belongs to the Special Issue Simulation, Experiment and Modeling of Coal Fires)
  • Review
  • Open Access
187 Citations
39,544 Views
57 Pages

5 January 2023

Transformer architectures are highly expressive because they use self-attention mechanisms to encode long-range dependencies in the input sequences. In this paper, we present a literature review on Transformer-based (TB) models, providing a detailed...

(This article belongs to the Special Issue Feature Papers for AI)
  • Article
  • Open Access
15 Citations
4,397 Views
20 Pages

18 November 2024

In this research, we introduce a novel method leveraging the Transformer architecture to generate high-fidelity precipitation model outputs. This technique emulates the statistical characteristics of high-resolution datasets while substantially lower...

(This article belongs to the Special Issue Precipitation, Flood and Earthquake Events Monitoring, Simulation, Analysis and Early Warning by Advanced Environmental Remote Sensing and AI)
  • Article
  • Open Access
356 Views
32 Pages

3 October 2026

Named Entity Recognition (NER) is a fundamental Natural Language Processing task, yet low-resource languages such as Tarifit Berber remain critically underexplored. This study introduces the first standardized and reproducible benchmark for Tarifit N...

(This article belongs to the Special Issue Information Extraction and Language Discourse Processing, 2nd Edition)
  • Article
  • Open Access
1,841 Views
33 Pages

Prediction of Marine Shaft Centerline Trajectories Using Transformer-Based Models

  • Jialin Han,
  • Qingbo Zhu,
  • Sheng Yang,
  • Wan Xia and
  • Yongjun Yao

18 January 2025

The accurate prediction of marine shaft centerline trajectories is essential for ensuring the operational performance and safety of ships. In this study, we propose a novel Transformer-based model to forecast the lateral and longitudinal displacement...

(This article belongs to the Section F: Engineering and Materials)
  • Article
  • Open Access
39 Citations
19,188 Views
29 Pages

28 February 2025

Accurate demand forecasting is essential for retail operations as it directly impacts supply chain efficiency, inventory management, and financial performance. However, forecasting retail time series presents significant challenges due to their irreg...

(This article belongs to the Special Issue Statistical Data Modeling and Machine Learning with Applications, 3rd Edition)
  • Article
  • Open Access
24 Citations
6,447 Views
10 Pages

In recent years, the transformer model has been widely used in computer-vision tasks and has achieved impressive results. Unfortunately, these transformer-based models have the common drawback of having many parameters and a large memory footprint, c...

(This article belongs to the Collection Graph Machine Learning)
  • Article
  • Open Access
65 Citations
11,567 Views
23 Pages

Detection of Depression Severity in Social Media Text Using Transformer-Based Models

  • Amna Qasim,
  • Gull Mehak,
  • Nisar Hussain,
  • Alexander Gelbukh and
  • Grigori Sidorov

7 February 2025

Depression, a serious mental health disorder, requires accurate classification for effective intervention. Existing methods often fail to capture nuanced emotional and linguistic cues, leading to suboptimal classification of depression severity. This...

(This article belongs to the Special Issue Application of Machine Learning in Data Science and Computational Intelligence)
  • Article
  • Open Access
47 Citations
15,632 Views
30 Pages

Explainable Aspect-Based Sentiment Analysis Using Transformer Models

  • Isidoros Perikos and
  • Athanasios Diamantopoulos

An aspect-based sentiment analysis (ABSA) aims to perform a fine-grained analysis of text to identify sentiments and opinions associated with specific aspects. Recently, transformers and large language models have demonstrated exceptional performance...

(This article belongs to the Special Issue Advances in Natural Language Processing and Text Mining)
  • Review
  • Open Access
50 Citations
12,936 Views
19 Pages

18 July 2024

The advancement of medical imaging has profoundly impacted our understanding of the human body and various diseases. It has led to the continuous refinement of related technologies over many years. Despite these advancements, several challenges persi...

(This article belongs to the Special Issue Transformer-Based Deep Learning in Medical Imaging and Healthy Sensors)
  • Article
  • Open Access
2 Citations
362 Views
34 Pages

7 October 2026

With the accelerated proliferation of the Internet of Things (IoT) and its widespread use in sensitive areas such as healthcare, homes, and factories, security has become an increasingly critical concern. IoT remains one of the most challenging domai...

(This article belongs to the Section Internet of Things)
  • Article
  • Open Access
692 Views
25 Pages

7 September 2026

Background/Objectives: Diabetic retinopathy is a major cause of preventable vision loss worldwide, making early and accurate disease grading crucial for timely treatment. Although convolutional neural network (CNN)- and transformer-based architecture...

(This article belongs to the Special Issue AI-Powered Ophthalmic Diagnostics: From Image Segmentation to Disease Classification)
  • Feature Paper
  • Article
  • Open Access
5 Citations
1,623 Views
16 Pages

5 February 2026

Photovoltaic systems represent one of the most reliable and widely used technologies for electricity generation from renewable energy sources, although their performance is affected by the occurrence of faults and defects that lead to energy losses a...

(This article belongs to the Special Issue Renewable Energy System Forecasting and Maintenance Management)
  • Article
  • Open Access
900 Views
21 Pages

This study investigates multi-label movie genre prediction from user-written reviews in which textual content is inherently subjective and the movies reviewed naturally belong to multiple genres. To address extreme class imbalance and label sparsity...

  • Article
  • Open Access
4 Citations
1,864 Views
27 Pages

Efficient Autonomy: Autonomous Driving of Retrofitted Electric Vehicles via Enhanced Transformer Modeling

  • Kai Wang,
  • Xi Zheng,
  • Zi-Jie Peng,
  • Cong-Chun Zhang and ,
  • Jun-Jie Tang and
  • Kuan-Min Mao
  • + 1 author+ 0 author

2 October 2025

In low-risk and open environments, such as farms and mining sites, efficient cargo transportation is essential. Despite the suitability of autonomous driving for these environments, its high deployment and maintenance costs limit large-scale adoption...

(This article belongs to the Section E: Electric Vehicles)
  • Article
  • Open Access
1,449 Views
28 Pages

Evaluating Pre-Trained Transformer-Based Models for Political Sentiment Analysis on Social Media

  • María Patricia Tzili Cruz,
  • Salvador Contreras Hernández,
  • José Martín Espínola Sánchez,
  • Raúl Hernández Medina and ,
  • Alma Alejandra Luna Gómez and
  • Adriana Marlene Pacheco Orozco
  • + 1 author+ 0 author

Sentiment analysis has broad applications in social media networks due to the high volume of user activity on diverse topics such as political debates. Transformer-based neural networks are among the technologies that achieve significant results in t...

(This article belongs to the Special Issue Sentiment-Driven Modelling in Business, Economics, and Social Sciences)
  • Article
  • Open Access
8 Citations
4,920 Views
15 Pages

Deep Learning-Based Context-Aware Video Content Analysis on IoT Devices

  • Gad Gad,
  • Eyad Gad,
  • Korhan Cengiz,
  • Zubair Fadlullah and
  • Bassem Mokhtar

Integrating machine learning with the Internet of Things (IoT) enables many useful applications. For IoT applications that incorporate video content analysis (VCA), deep learning models are usually used due to their capacity to encode the high-dimens...

(This article belongs to the Collection Image and Video Analysis and Understanding)
  • Article
  • Open Access
1 Citations
922 Views
22 Pages

28 November 2025

A series of machine learning models have been proposed in the past decades, but it remains undetermined which is optimal for specific applications. Establishing mathematical prediction models for dam deformation and structural health monitoring based...

(This article belongs to the Section Modelling in Engineering Structures)
  • Article
  • Open Access
9 Citations
3,914 Views
22 Pages

Romanian Fake News Detection Using Machine Learning and Transformer-Based Approaches

  • Elisa Valentina Moisi,
  • Bogdan Cornel Mihalca,
  • Simina Maria Coman,
  • Alexandrina Mirela Pater and
  • Daniela Elena Popescu

18 December 2024

Nowadays, the consequence of quick access to information has lead to the spread of fake news, which has a strong damaging impact on democracy, justice, and public trust. Thus, it is crucial to analyze and evaluate detection methods for fake news. Thi...

  • Article
  • Open Access
7 Citations
4,318 Views
36 Pages

Social media is crucial for gathering public feedback on government services, particularly in the traffic sector. While Aspect-Based Sentiment Analysis (ABSA) offers a means to extract actionable insights from user posts, analyzing Arabic content pos...

  • Article
  • Open Access
1 Citations
2,836 Views
26 Pages

Axiom Generation for Automated Ontology Construction from Texts Through Schema Mapping

  • Tsitsi Zengeya,
  • Jean Vincent Fonou-Dombeu and
  • Mandlenkosi Gwetu

Ontology learning from unstructured text has become a critical task for knowledge-driven applications in Big Data and Artificial Intelligence. While significant advances have been made in the automatic extraction of concepts and relations using neura...

(This article belongs to the Section Data)
  • Article
  • Open Access
15 Citations
4,638 Views
20 Pages

Misinformation, fake news, and various propaganda techniques are increasingly used in digital media. It becomes challenging to uncover propaganda as it works with the systematic goal of influencing other individuals for the determined ends. While sig...

(This article belongs to the Special Issue Advances in Natural Language Processing and Text Mining)
  • Article
  • Open Access
33 Citations
7,420 Views
16 Pages

21 February 2024

In greenhouses, plant growth is directly influenced by internal environmental conditions, and therefore requires continuous management and proper environmental control. Inadequate environmental conditions make plants vulnerable to pests and diseases,...

(This article belongs to the Special Issue The Applications of Deep Learning in Smart Agriculture)
  • Article
  • Open Access
1 Citations
447 Views
23 Pages

16 July 2026

Deep learning methods have exemplified performance in various dental image segmentation tasks. However, their interpretability inadequacy remains a hindrance to clinical adoption. This study introduces a quantitative explainability-driven evaluation...

(This article belongs to the Special Issue Medical Image Analysis for Computer-Aided Diagnosis and Therapy)
  • Article
  • Open Access
20 Citations
6,845 Views
22 Pages

Pre-Trained Transformer-Based Models for Text Classification Using Low-Resourced Ewe Language

  • Victor Kwaku Agbesi,
  • Wenyu Chen,
  • Sophyani Banaamwini Yussif,
  • Md Altab Hossin and ,
  • Chiagoziem C. Ukwuoma,
  • Noble A. Kuadey,
  • Colin Collinson Agbesi,
  • Nagwan Abdel Samee,
  • Mona M. Jamjoom and
  • Mugahed A. Al-antari
  • + 5 authors+ 0 author

19 December 2023

Despite a few attempts to automatically crawl Ewe text from online news portals and magazines, the African Ewe language remains underdeveloped despite its rich morphology and complex "unique" structure. This is due to the poor quality, unbalanced, an...

  • Article
  • Open Access
22 Citations
6,412 Views
31 Pages

A Comparative Evaluation of Transformer-Based Language Models for Topic-Based Sentiment Analysis

  • Spyridon Tzimiris,
  • Stefanos Nikiforos,
  • Maria Nefeli Nikiforos,
  • Despoina Mouratidis and
  • Katia Lida Kermanidis

This research investigates topic-based sentiment classification in Greek educational-related data using transformer-based language models. A comparative evaluation is conducted on GreekBERT, XLM-r-Greek, mBERT, and Palobert using three original senti...

(This article belongs to the Special Issue Emerging Theory and Applications in Natural Language Processing, 2nd Edition)
  • Article
  • Open Access
371 Views
35 Pages

16 September 2026

Rapid release cycles and user-centric design have transformed requirement engineering into a continuous process within software development. Analyzing user-generated feedback from diverse online platforms is essential for feature prioritization. Whil...

(This article belongs to the Special Issue Advances in Data-Driven Artificial Intelligence, 2nd Edition)
  • Article
  • Open Access
18 Citations
6,969 Views
20 Pages

On the Use of Transformer-Based Models for Intent Detection Using Clustering Algorithms

  • André Moura,
  • Pedro Lima,
  • Fábio Mendonça,
  • Sheikh Shanawaz Mostafa and
  • Fernando Morgado-Dias

21 April 2023

Chatbots are becoming increasingly popular and require the ability to interpret natural language to provide clear communication with humans. To achieve this, intent detection is crucial. However, current applications typically need a significant amou...

(This article belongs to the Special Issue New Trends on Machine Learning Based Pattern Recognition and Classification)
  • Article
  • Open Access
6 Citations
2,471 Views
29 Pages

An Interpretable Multi-Dataset Learning Framework for Breast Cancer Prediction Using Clinical and Biomedical Tabular Data

  • Muhammad Ateeb Ather,
  • Abdullah,
  • Zulaikha Fatima,
  • José Luis Oropeza Rodríguez and
  • Grigori Sidorov

2 February 2026

Despite the numerous advancements that have been made in the treatment and management of breast cancer, it continues to be a source of mortality in millions of female patients across the world each year; thus, there is a need for proper and reliable...

(This article belongs to the Special Issue Machine and Deep Learning in the Health Domain (3rd Edition))
  • Review
  • Open Access
92 Citations
19,223 Views
25 Pages

16 March 2023

Transfer learning is a technique utilized in deep learning applications to transmit learned inference to a different target domain. The approach is mainly to solve the problem of a few training datasets resulting in model overfitting, which affects m...

(This article belongs to the Collection Natural Language Processing and Applications: Challenges and Perspectives)
  • Article
  • Open Access
28 Citations
4,336 Views
17 Pages

High-Speed and Accurate Diagnosis of Gastrointestinal Disease: Learning on Endoscopy Images Using Lightweight Transformer with Local Feature Attention

  • Shibin Wu,
  • Ruxin Zhang,
  • Jiayi Yan,
  • Chengquan Li and ,
  • Qicai Liu,
  • Liyang Wang and
  • Haoqian Wang
  • + 2 authors+ 0 author

In response to the pressing need for robust disease diagnosis from gastrointestinal tract (GIT) endoscopic images, we proposed FLATer, a fast, lightweight, and highly accurate transformer-based model. FLATer consists of a residual block, a vision tra...

(This article belongs to the Special Issue Recent Advance of Machine Learning in Biomedical Image Analysis)
  • Article
  • Open Access
13 Citations
4,424 Views
20 Pages

A Multi-Scale Approach to Early Fire Detection in Smart Homes

  • Akmalbek Abdusalomov,
  • Sabina Umirzakova,
  • Furkat Safarov,
  • Sanjar Mirzakhalilov and ,
  • Nodir Egamberdiev and
  • Young-Im Cho
  • + 1 author+ 0 author

6 November 2024

In recent years, advancements in smart home technologies have underscored the need for the development of early fire and smoke detection systems to enhance safety and security. Traditional fire detection methods relying on thermal or smoke sensors ex...

(This article belongs to the Special Issue Pattern Recognition and Sensor Fusion Solutions in Intelligent Sensor Systems, 2nd Edition)
  • Feature Paper
  • Article
  • Open Access
2 Citations
1,401 Views
17 Pages

27 October 2025

A numerical method to estimate the plasma characteristics with the variation in control parameters is suggested with an artificial intelligence model using limited finite datasets. A transformer-based regression method was applied to estimate the spa...

(This article belongs to the Section Surface Characterization, Deposition and Modification)
  • Article
  • Open Access
15 Citations
4,191 Views
16 Pages

The increasing use of electronic health records (EHRs) generates a vast amount of data, which can be leveraged for predictive modeling and improving patient outcomes. However, EHR data are typically mixtures of structured and unstructured data, which...

(This article belongs to the Section Artificial Intelligence)
  • Review
  • Open Access
3 Citations
1,811 Views
40 Pages

A Comparative Study of Emotion Recognition Systems: From Classical Approaches to Multimodal Large Language Models

  • Mirela-Magdalena Grosu (Marinescu),
  • Octaviana Datcu,
  • Ruxandra Tapu and
  • Bogdan Mocanu

27 January 2026

Emotion recognition in video (ERV) aims to infer human affect from visual, audio, and contextual signals and is increasingly important for interactive and intelligent systems. Over the past decade, ERV has evolved from handcrafted features and task-s...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
2 Citations
1,469 Views
28 Pages

12 February 2026

This paper presents a systematic comparative study of optical character recognition (OCR) architectures for Korean license plate recognition under identical detection conditions. Although recent automatic license plate recognition (ALPR) systems incr...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
1,574 Views
27 Pages

Reservoir release induced flooding is a major downstream hazard worldwide, yet most warning systems rely on hydraulic modeling and underuse real time reservoir operation data. This study presents a data driven framework to detect flood discharge even...

(This article belongs to the Special Issue Digital Twin-Enabled Hydrological and Hydropower Systems for Reservoir Inflow Modelling)
  • Article
  • Open Access
3 Citations
2,988 Views
28 Pages

23 October 2025

Understanding visitor sentiment is essential for developing effective tourism strategies, particularly as Google Maps reviews have become a key channel for public feedback on tourist attractions. Yet, the unstructured format and dialectal diversity o...

  • Article
  • Open Access
1 Citations
919 Views
17 Pages

A Transformer-Based Deep Learning Method for Inverse Design of Electromagnetically Induced Transparency Metasurfaces

  • Hongyan Meng,
  • Hengli Feng,
  • Yang Liu,
  • Wenqiang Shi and ,
  • Jue Wang,
  • Yang Jia,
  • Jijuan Jiang,
  • Guan Wang,
  • Jia Liu and
  • Yachen Gao
  • + 7 authors+ 2 authors

In this work, we propose a novel transformer-based deep learning model for the design of electromagnetically induced transparency (EIT) metasurfaces, which consists of a forward network to predict transmission spectra from structural parameters and a...

(This article belongs to the Special Issue Optical Metasurfaces for Next-Generation Communication and Sensing)

of 476