Skip to Content
You are currently on the new version of our website. Access the old version .

17 Results Found

  • Article
  • Open Access
7 Citations
3,511 Views
26 Pages

Symmetry and Asymmetry in Pre-Trained Transformer Models: A Comparative Study of TinyBERT, BERT, and RoBERTa for Chinese Educational Text Classification

  • Munire Muhetaer,
  • Xiaoyan Meng,
  • Jing Zhu,
  • Aixiding Aikebaier and ,
  • Liyaer Zu and
  • Yawen Bai
  • + 1 author+ 0 author

27 October 2025

With the advancement of educational informatization, vast amounts of Chinese text are generated across online platforms and digital textbooks. Effectively classifying such text is essential for intelligent education systems. This study conducts a sys...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
7 Citations
4,431 Views
12 Pages

24 January 2025

Background: Large language models (LLMs) have seen a significant boost recently in the field of natural language processing (NLP) due to their capabilities in analyzing words. These autoregressive models prove robust in classification tasks where tex...

(This article belongs to the Section Methodology, Drug and Device Discovery)
  • Article
  • Open Access
1 Citations
667 Views
24 Pages

TR-BiGRU-CRF: A Lightweight Key Information Extraction Approach for Civil Aviation Flight Crew Operational Instructions

  • Weijun Pan,
  • Yao Zheng,
  • Yidi Wang,
  • Sheng Chen and ,
  • Qinghai Zuo,
  • Tian Luan and
  • Chen Zeng
  • + 2 authors+ 0 author

2 April 2026

To enhance flight safety and operational efficiency, extracting key actions, flight parameters, and status information from civil aviation flight crew instructions generated during pre-flight and in-flight procedures is crucial. However, such texts a...

(This article belongs to the Topic AI-Enhanced Techniques for Air Traffic Management)
  • Article
  • Open Access
575 Views
23 Pages

14 June 2026

Bug severity classification is an important task in software maintenance because it supports bug triage and resource allocation. However, newly created or evolving projects often lack sufficient labeled data, making cross-project severity prediction...

(This article belongs to the Special Issue Applied Artificial Intelligence and Software Engineering)
  • Feature Paper
  • Article
  • Open Access
14 Citations
4,514 Views
30 Pages

Differential Impacts of Environmental, Social, and Governance News Sentiment on Corporate Financial Performance in the Global Market: An Analysis of Dynamic Industries Using Advanced Natural Language Processing Models

  • Minjoong Kim,
  • Jinseong Kang,
  • Insoo Jeon,
  • Juyeon Lee and ,
  • Jungwon Park,
  • Seulgi Youm,
  • Jonghee Jeong,
  • Jiyoung Woo and
  • Jihoon Moon
  • + 4 authors+ 0 author

17 November 2024

This study examines how sentiment analysis of environmental, social, and governance (ESG) news affects the financial performance of companies in innovative sectors such as mobility, technology, and renewable energy. Using approximately 9828 general E...

(This article belongs to the Special Issue Advances in Intelligent Data Analysis and Its Applications, 2nd Edition)
  • Article
  • Open Access
20 Citations
6,431 Views
14 Pages

MicroBERT: Distilling MoE-Based Knowledge from BERT into a Lighter Model

  • Dashun Zheng,
  • Jiaxuan Li,
  • Yunchu Yang,
  • Yapeng Wang and
  • Patrick Cheong-Iao Pang

16 July 2024

Natural language-processing tasks have been improved greatly by large language models (LLMs). However, numerous parameters make their execution computationally expensive and difficult on resource-constrained devices. For this problem, as well as main...

(This article belongs to the Special Issue New Trends in Natural Language Processing)
  • Article
  • Open Access
1,156 Views
29 Pages

Online hotel reviews provide a major source of information for understanding guest satisfaction, yet rating prediction remains difficult because review text is often short, highly skewed toward positive scores, and affected by inconsistent or repetit...

(This article belongs to the Topic Artificial Intelligence Models, Tools and Applications: 2nd Edition)
  • Article
  • Open Access
195 Views
35 Pages

Lightweight Multimodal Frameworks for Fake News Detection Using Cross-Modal Consistency Modeling and Parameter-Efficient Attention

  • Sarab AlMuhaideb,
  • Hajar Almeleehan,
  • Jana Alamer,
  • Sarah Aljuhani and ,
  • Dimah Alotaibi and
  • Athoog Alsuhaibany
  • + 1 author+ 0 author

30 October 2026

The rapid proliferation of fake news poses significant societal and psychological risks, driving an urgent need for automated detection systems. While conventional unimodal methods fail to capture complex cross-modal relationships, existing multimoda...

(This article belongs to the Special Issue Latest Research on Computer Vision and Image Processing, 2nd Edition)
  • Article
  • Open Access
633 Views
32 Pages

4 May 2026

We study language-guided target localization in synthetic aperture radar (SAR) imagery for deployment on resource-constrained platforms. Existing vision-language models either rely on heavy backbones unsuitable for edge devices or are designed for na...

(This article belongs to the Special Issue Radar and Photo-Electronic Multi-Modal Intelligent Fusion)
  • Article
  • Open Access
11 Citations
6,441 Views
26 Pages

Optimizing BFloat16 Deployment of Tiny Transformers on Ultra-Low Power Extreme Edge SoCs

  • Alberto Dequino,
  • Luca Bompani,
  • Luca Benini and
  • Francesco Conti

Transformers have emerged as the central backbone architecture for modern generative AI. However, most ML applications targeting low-power, low-cost SoCs (TinyML apps) do not employ Transformers as these models are thought to be challenging to quanti...

  • Article
  • Open Access
6 Citations
5,845 Views
25 Pages

Evaluating the Effectiveness of Large Language Models (LLMs) Versus Machine Learning (ML) in Identifying and Detecting Phishing Email Attempts

  • Saed Tarapiah,
  • Linda Abbas,
  • Oula Mardawi,
  • Shadi Atalla and ,
  • Yassine Himeur and
  • Wathiq Mansoor
  • + 1 author+ 0 author

25 September 2025

Phishing emails remain a significant concern and a growing cybersecurity threat in online communication. They often bypass traditional filters due to their increasing sophistication. This study presents a comparative evaluation of machine learning (M...

(This article belongs to the Section Evolutionary Algorithms and Machine Learning)
  • Article
  • Open Access
573 Views
30 Pages

With the widespread deployment of IoT devices, deploying efficient network traffic classification models on resource-constrained edge nodes is critical for real-time boundary security. However, traditional lightweight models primarily rely on macro-l...

  • Article
  • Open Access
1 Citations
3,618 Views
14 Pages

22 September 2024

In general, it is difficult to obtain a huge, labeled dataset for deep learning-based phoneme recognition in singing voices. Studying singing voices also offers inherent challenges, compared to speech, because of the distinct variations in pitch, dur...

  • Feature Paper
  • Article
  • Open Access
1 Citations
2,132 Views
40 Pages

13 February 2025

In this article, we present a model for analyzing the co-occurrence count data derived from practical fields such as user–item or item–item data from online shopping platforms and co-occurring word–word pairs in sequences of texts....

(This article belongs to the Section D1: Probability and Statistics)
  • Article
  • Open Access
71 Citations
13,685 Views
34 Pages

Tiny Language Models for Automation and Control: Overview, Potential Applications, and Future Research Directions

  • Ismail Lamaakal,
  • Yassine Maleh,
  • Khalid El Makkaoui,
  • Ibrahim Ouahbi and ,
  • Paweł Pławiak,
  • Osama Alfarraj,
  • May Almousa and
  • Ahmed A. Abd El-Latif
  • + 3 authors+ 0 author

21 February 2025

Large Language Models (LLMs), like GPT and BERT, have significantly advanced Natural Language Processing (NLP), enabling high performance on complex tasks. However, their size and computational needs make LLMs unsuitable for deployment on resource-co...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
182 Views
29 Pages

Mitigating Text Dominance in Medical Vision–Language Learning for Long-Tailed Multi-Label Chest X-Ray Classification

  • Aqeeb Hussain,
  • Sabeen Masood,
  • Samera Batool,
  • Ali Hassan and ,
  • Shuja Ansari,
  • Sanaa Ghouzali and
  • Wadood Abdul
  • + 2 authors+ 0 author

28 October 2026

Background/Objectives: Medical vision–language learning integrates radiographic images and textual information for chest X-ray (CXR) classification. However, in long-tailed multi-label CXR classification, modality imbalance can cause models to...

(This article belongs to the Special Issue Artificial Intelligence in Medical Image Analysis and Clinical Decision Support)
  • Article
  • Open Access
301 Views
21 Pages

Stage-Oriented Text Classification for Russian-Language Clinical and Genetic Documents: Pre-Genetic Triage and Post-Genetic Report Interpretation

  • Assem Shayakhmetova,
  • Madina Sambetbayeva,
  • Vladimir Barakhnin,
  • Anar Sultangaziyeva and ,
  • Nurzhan Mukazhanov,
  • Ardak Batyrkhanov,
  • Sandugash Serikbayeva and
  • Raushan Begim
  • + 3 authors+ 0 author

27 August 2026

The growing volume of unstructured clinical and genetic text calls for automated processing methods that can meaningfully support clinical decision-making. Most existing work, however, treats the analysis of patient clinical descriptions and the inte...

(This article belongs to the Special Issue Data Mining and Healthcare Informatics)