Skip to Content

54 Results Found

  • Article
  • Open Access
3 Citations
771 Views
17 Pages

LoRAD: Logic-Reasoning Augmented DeBERTa with Adversarial Training for Robust Rumor Detection

  • Yinhao Zhang,
  • Farkhana Muchtar,
  • Mohd Kufaisal Mohd Sidik and
  • Johan Mohamad Sharif

28 February 2026

Social media has greatly accelerated the speed of information dissemination, but it has also inevitably led to a proliferation of rumors. Due to the deceptive nature of rumors, people often find it difficult to distinguish truth from falsehood, resul...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
7 Citations
3,067 Views
21 Pages

A DeBERTa-Based Semantic Conversion Model for Spatiotemporal Questions in Natural Language

  • Wenjuan Lu,
  • Dongping Ming,
  • Xi Mao,
  • Jizhou Wang and ,
  • Zhanjie Zhao and
  • Yao Cheng
  • + 1 author+ 0 author

22 January 2025

To address current issues in natural language spatiotemporal queries, including insufficient question semantic understanding, incomplete semantic information extraction, and inaccurate intent recognition, this paper proposes NL2Cypher, a DeBERTa (Dec...

  • Article
  • Open Access
30 Citations
6,606 Views
22 Pages

10 October 2024

Depression detection through social media analysis has emerged as a promising approach for early intervention and mental health support. This study evaluates the performance of various machine learning and transformer models in identifying depressive...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
10 Citations
3,434 Views
33 Pages

Hybrid Transformer-Based Large Language Models for Word Sense Disambiguation in the Low-Resource Sesotho sa Leboa Language

  • Hlaudi Daniel Masethe,
  • Mosima Anna Masethe,
  • Sunday O. Ojo,
  • Pius A. Owolawi and
  • Fausto Giunchiglia

25 March 2025

This study addresses a lexical ambiguity issue in Sesotho sa Leboa that arises from terms with various meanings, often known as homonyms or polysemous words. When compared to, for instance, European languages, this lexical ambiguity in Sesotho sa Leb...

(This article belongs to the Special Issue Advances in Large Language Models: Techniques, Applications and Challenges)
  • Article
  • Open Access
89 Views
30 Pages

1 November 2026

Political misinformation spans fact-checked claims and news headlines, yet detection models are often evaluated within a single corpus and input representation. This study presents a metadata-flexible transformer framework evaluated on LIAR2 (19,212...

(This article belongs to the Special Issue Advances in NLP and Large Language Models: Methods, Systems, and Applications)
  • Article
  • Open Access
1 Citations
1,315 Views
57 Pages

4 June 2026

The manual classification of diplomatic documents by security sensitivity level is labor-intensive and inconsistent at scale. This study proposes SACHN-DeBERTa-v3-Large, a hybrid classification architecture integrating a DeBERTa-v3-Large backbone wit...

  • Article
  • Open Access
6 Citations
2,157 Views
15 Pages

DABC: A Named Entity Recognition Method Incorporating Attention Mechanisms

  • Fangling Leng,
  • Fan Li,
  • Yubin Bao,
  • Tiancheng Zhang and
  • Ge Yu

27 June 2024

Regarding the existing models for feature extraction of complex similar entities, there are problems in the utilization of relative position information and the ability of key feature extraction. The distinctiveness of Chinese named entity recognitio...

(This article belongs to the Special Issue Data Mining and Machine Learning in the Era of Big Knowledge and Large Models)
  • Article
  • Open Access
2 Citations
2,385 Views
18 Pages

15 August 2025

Spam emails pose ongoing risks to digital security, including data breaches, privacy violations, and financial losses. Addressing the limitations of traditional detection systems in terms of accuracy, adaptability, and resilience remains a significan...

(This article belongs to the Section Evolutionary Algorithms and Machine Learning)
  • Article
  • Open Access
2 Citations
2,674 Views
18 Pages

A Context-Aware Representation-Learning-Based Model for Detecting Human-Written and AI-Generated Cryptocurrency Tweets Across Large Language Models

  • Muhammad Asad Arshed,
  • Ştefan Cristian Gherghina,
  • Iqra Khalil,
  • Hasnain Muavia and ,
  • Anum Saleem and
  • Hajran Saleem
  • + 1 author+ 0 author

29 November 2025

The extensive use of large language models (LLMs), particularly in the finance sector, raises concerns about the authenticity and reliability of generated text. Developing a robust method for distinguishing between human-written and AI-generated fina...

  • Article
  • Open Access
1,498 Views
26 Pages

In semantic classification of katakana words using large language models and pre-trained language models, semantic divergences from original English meanings, such as those found in Wasei-Eigo which is Japanese-made English, and the inherent sense am...

(This article belongs to the Special Issue Artificial Intelligence (AI) and Natural Language Processing (NLP))
  • Article
  • Open Access
7 Citations
2,491 Views
31 Pages

5 July 2025

The increasing sophistication of cyberattacks on smart grid infrastructure demands advanced anomaly detection and recovery systems that balance high recall rates with acceptable precision while providing reliable data restoration capabilities. This s...

(This article belongs to the Section Electronic Sensors)
  • Article
  • Open Access
2 Citations
591 Views
27 Pages

Automated screening of political claims is challenging because many statements are short, underspecified, and labeled with fine-grained truthfulness categories that are difficult to separate using claim text alone. This study examines whether lightwe...

(This article belongs to the Special Issue Artificial Intelligence (AI) and Natural Language Processing (NLP))
  • Article
  • Open Access
411 Views
37 Pages

Few-shot stressor extraction from temporally evolving social-media text remains challenging, primarily because of unstable span boundaries and the imperfect correspondence between structural confidence and task-semantic validity. We propose VFR-MISE,...

(This article belongs to the Special Issue Natural Language Processing and Text Analysis in Social Media)
  • Article
  • Open Access
690 Views
23 Pages

Integrating Retrieval-Augmented Generation with Large Language Model for Robust and Explainable AI Text Detection

  • Ibtasam Ur Rehman,
  • Muhammad Islam,
  • Muhammad Yousaf Rehman and
  • Basharat Hussain

Large Language Models (LLMs) have been rapidly evolving lately, resulting in the need for strong, explainable models to detect the difference between human-generated and machine-generated articles. Existing approaches which are mostly based on fine-t...

  • Article
  • Open Access
11 Citations
3,777 Views
30 Pages

DeB3RTa: A Transformer-Based Model for the Portuguese Financial Domain

  • Higo Pires,
  • Leonardo Paucar and
  • Joao Paulo Carvalho

The complex and specialized terminology of financial language in Portuguese-speaking markets create significant challenges for natural language processing (NLP) applications, which must capture nuanced linguistic and contextual information to support...

  • Article
  • Open Access
733 Views
24 Pages

In the contemporary field of geographic information, place name services serve as a core application support in geographic information science, widely applied in public services, cultural tourism, emergency management, and other scenarios. Place name...

  • Article
  • Open Access
23 Citations
8,732 Views
22 Pages

The widespread rise of misinformation across digital platforms has increased the demand for accurate and efficient Fake News Detection (FND) systems. This study introduces an enhanced transformer-based architecture for FND, developed through comprehe...

(This article belongs to the Special Issue Cyber Security and Digital Forensics—2nd Edition)
  • Article
  • Open Access
3 Citations
2,761 Views
23 Pages

28 March 2026

The detection of corruption-related indicators within unstructured, textual procurement data remains a complex task due to linguistic ambiguity, contextual variation and domain-specific terminology. This study presents a comparative evaluation of thr...

(This article belongs to the Collection Natural Language Processing and Applications: Challenges and Perspectives)
  • Article
  • Open Access
3 Citations
4,496 Views
15 Pages

Enhancements in BlenderBot 3: Expanding Beyond a Singular Model Governance and Boosting Generational Performance

  • Ondrej Kobza,
  • David Herel,
  • Jan Cuhel,
  • Tommaso Gargiani and ,
  • Jan Pichl,
  • Petr Marek,
  • Jakub Konrad and
  • Jan Sedivy
  • + 3 authors+ 0 author

28 November 2023

This paper provides a pioneering examination and enhancement of generative chat models, with a specific focus on the BlenderBot 3 model. Through meticulous interaction with a diverse set of human participants, we dissected the fundamental components...

  • Article
  • Open Access
569 Views
16 Pages

From Bug Reports to Code Quality: A Transformer-Based Classification Approach Using CodeBERT

  • Kanwal Naz,
  • Imran Shafi,
  • M. Zakria Mehmood,
  • Abdul Saboor Khan and
  • Jamil Ahmad

Maintaining code quality during software maintenance is a persistent challenge because bug-fix activities frequently introduce new code smells, accelerating long-term technical debt. Although bug-report classification has been applied to severity pre...

  • Article
  • Open Access
12 Citations
5,614 Views
20 Pages

A Deep Learning-Based Method for Preventing Data Leakage in Electric Power Industrial Internet of Things Business Data Interactions

  • Weiwei Miao,
  • Xinjian Zhao,
  • Yinzhao Zhang,
  • Shi Chen and ,
  • Xiaochao Li and
  • Qianmu Li
  • + 1 author+ 0 author

22 June 2024

In the development of the Power Industry Internet of Things, the security of data interaction has always been an important challenge. In the power-based blockchain Industrial Internet of Things, node data interaction involves a large amount of sensit...

(This article belongs to the Section Communications)
  • Article
  • Open Access
85 Citations
21,145 Views
20 Pages

24 October 2023

Detecting depression from user-generated content on social media platforms has garnered significant attention due to its potential for the early identification and monitoring of mental health issues. This paper presents a comprehensive approach for d...

(This article belongs to the Special Issue AI in Knowledge-Based Information and Decision Support Systems)
  • Article
  • Open Access
18 Citations
5,231 Views
20 Pages

Multi-Level Depression Severity Detection with Deep Transformers and Enhanced Machine Learning Techniques

  • Nisar Hussain,
  • Amna Qasim,
  • Gull Mehak,
  • Muhammad Zain and ,
  • Grigori Sidorov,
  • Alexander Gelbukh and
  • Olga Kolesnikova
  • + 2 authors+ 0 author

15 July 2025

Depression is now one of the most common mental health concerns in the digital era, calling for powerful computational tools for its detection and its level of severity estimation. A multi-level depression severity detection framework in the Reddit s...

(This article belongs to the Special Issue AI in Bio and Healthcare Informatics)
  • Article
  • Open Access
20 Citations
6,801 Views
22 Pages

Pre-Trained Transformer-Based Models for Text Classification Using Low-Resourced Ewe Language

  • Victor Kwaku Agbesi,
  • Wenyu Chen,
  • Sophyani Banaamwini Yussif,
  • Md Altab Hossin and ,
  • Chiagoziem C. Ukwuoma,
  • Noble A. Kuadey,
  • Colin Collinson Agbesi,
  • Nagwan Abdel Samee,
  • Mona M. Jamjoom and
  • Mugahed A. Al-antari
  • + 5 authors+ 0 author

19 December 2023

Despite a few attempts to automatically crawl Ewe text from online news portals and magazines, the African Ewe language remains underdeveloped despite its rich morphology and complex "unique" structure. This is due to the poor quality, unbalanced, an...

  • Article
  • Open Access
18 Citations
5,789 Views
14 Pages

18 July 2024

This study compares the effectiveness of fine-tuning Transformer models, specifically BERT, RoBERTa, DeBERTa, and GPT-2, against using prompt engineering in LLMs like ChatGPT and GPT-4 for multi-class classification of hotel reviews. As the hospitali...

(This article belongs to the Special Issue Neural Network Technologies in Natural Language Processing and Data Mining)
  • Article
  • Open Access
1 Citations
1,338 Views
21 Pages

8 September 2025

Due to the increasing harmfulness of software vulnerabilities, it is increasingly suggested to propose more efficient vulnerability assessment methods. However, existing methods mainly rely on manual updates and inefficient rule matching, and they st...

(This article belongs to the Topic Addressing Security Issues Related to Modern Software)
  • Article
  • Open Access
4 Citations
6,150 Views
29 Pages

30 September 2024

Natural language inference (NLI) is a fundamental and quite challenging task in natural language processing, requiring efficient methods that are able to determine whether given hypotheses derive from given premises. In this paper, we apply explainab...

(This article belongs to the Special Issue Advances in Artificial Intelligence Engineering)
  • Article
  • Open Access
23 Citations
10,622 Views
35 Pages

Bias and Cyberbullying Detection and Data Generation Using Transformer Artificial Intelligence Models and Top Large Language Models

  • Yulia Kumar,
  • Kuan Huang,
  • Angelo Perez,
  • Guohao Yang and ,
  • J. Jenny Li,
  • Patricia Morreale,
  • Dov Kruger and
  • Raymond Jiang
  • + 3 authors+ 0 author

29 August 2024

Despite significant advancements in Artificial Intelligence (AI) and Large Language Models (LLMs), detecting and mitigating bias remains a critical challenge, particularly on social media platforms like X (formerly Twitter), to address the prevalent...

(This article belongs to the Special Issue Emerging Artificial Intelligence Technologies and Applications)
  • Article
  • Open Access
1,026 Views
19 Pages

Ontology Construction for Agri-Text Using Hybrid NLP with Deep Learning Methods

  • Baghavathi Priya Sankaralingam,
  • Krithikha Sanju Saravanan,
  • Vaishnavi Vennila Balasubramanian and
  • Bollimuntha Navya Sai

Developing an agricultural ontology will facilitate the advancement of agriculture in transferring information between fields and natural language processing (NLP). Grammatical and contextual comprehension of the domain data is required to construct...

  • Article
  • Open Access
2 Citations
1,281 Views
22 Pages

26 March 2026

The increasing demand for scalable and fair assessment of open-form responses in digital education shows the need for intelligent grading systems capable of balancing syntactic precision with semantic understanding. This study proposes a hybrid seman...

(This article belongs to the Special Issue Applications of Artificial Intelligence in Innovative Education)
  • Article
  • Open Access
324 Views
28 Pages

Augmentation of Sentiment Analysis Models

  • Christopher Henshaw,
  • Jared Byers and
  • Alan J. Michaels

20 September 2026

Sentiment analysis is widely used to quantify the emotional tone of text. However, many pretrained sentiment models are only designed for short inputs and can struggle when applied to longer compilations of text or even full documents. These limitati...

(This article belongs to the Special Issue AI-Powered Natural Language Processing Applications)
  • Article
  • Open Access
354 Views
17 Pages

10 October 2026

Rapid growth in IoT devices has led to the creation of crucial cybersecurity threats since existing methods of malware detection which use signature matching and numerical feature analysis are incapable of capturing the contextual behavioral semantic...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
558 Views
22 Pages

SeSKGC: A Semantic–Structural Fusion Framework for Knowledge Graph Completion

  • Ping Feng,
  • Siqi Xu,
  • Xinping Du,
  • Yan Chen and
  • Yuyuan Dong

26 April 2026

Knowledge graphs play a vital role in tasks such as recommendation systems, question-answering systems, and information retrieval. However, during practical construction, they commonly suffer from structural incompleteness and sparse relationships, w...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
3 Citations
3,499 Views
22 Pages

28 November 2023

Binary code similarity detection (BCSD) plays a vital role in computer security and software engineering. Traditional BCSD methods heavily rely on specific features and necessitate rich expert knowledge, which are sensitive to code alterations. To im...

(This article belongs to the Special Issue Machine Learning for Cybersecurity Threats, Challenges, and Opportunities III)
  • Article
  • Open Access
9 Citations
3,575 Views
19 Pages

A Novel Hybrid Attention-Based RoBERTa-BiLSTM Model for Cyberbullying Detection

  • Mohammed A. Mahdi,
  • Suliman Mohamed Fati,
  • Mohammed Gamal Ragab,
  • Mohamed A. G. Hazber and ,
  • Shahanawaj Ahamad,
  • Sawsan A. Saad and
  • Mohammed Al-Shalabi
  • + 2 authors+ 0 author

The escalating scale and psychological harm of cyberbullying across digital platforms present a critical social challenge, demanding the urgent development of highly accurate and reliable automated detection systems. Standard fine-tuned transformer m...

  • Article
  • Open Access
64 Views
21 Pages

3 November 2026

In this paper, we explore the ability of generative models to integrate deterministically hashed representations of information in the context of higher education. We compare BERT, RoBERTa, and GPT-2 base configurations for predicting undergraduate g...

(This article belongs to the Special Issue Generative AI: From Theory to Applications)
  • Article
  • Open Access
1 Citations
1,088 Views
16 Pages

30 March 2026

This work explores how deep learning models, with different numbers of parameters, can be effectively applied to detect personal data within unstructured text using Named Entity Recognition (NER) techniques. We evaluate the performance of various arc...

(This article belongs to the Special Issue Artificial Intelligence on the Edge for Industry 4.0)
  • Opinion
  • Open Access
922 Views
12 Pages

Berta Cáceres’s life and struggle embody a biocultural ethic that conceives rivers as living co-inhabitants whose protection requires ethical commitment, collective organization, and institutional transformation. Her work offers a paradi...

(This article belongs to the Special Issue More-than-Human Ethics: Rethinking Nature, Dwelling, and Responsibility)
  • Article
  • Open Access
25 Citations
5,628 Views
23 Pages

The rising prevalence of social media turns them into huge, rich repositories of human emotions. Understanding and categorizing human emotion from social media content is of fundamental importance for many reasons, such as improvement of user experie...

(This article belongs to the Special Issue Advances in Natural Language Processing and Text Mining)
  • Article
  • Open Access
31 Citations
7,838 Views
20 Pages

18 February 2025

Public opinion comments are important for the public to express their emotions and demands. Accordingly, identifying the public emotions contained in comments and taking corresponding countermeasures according to the changes in the emotions are of gr...

  • Article
  • Open Access
15 Citations
8,841 Views
16 Pages

13 January 2025

The importance of sentiment analysis in the rapidly evolving financial markets is widely recognized for its ability to interpret market trends and inform investment decisions. This study delves into the target-level financial sentiment analysis (TLFS...

(This article belongs to the Section Evolutionary Algorithms and Machine Learning)
  • Abstract
  • Open Access
2,502 Views
1 Page

In the last decade, advances in statistical modeling and computer science have boosted the production of machine-produced contents in different fields: from language to image generation, the quality of the generated outputs is remarkably high, someti...

(This article belongs to the Proceedings of Global Safety Evaluation (GSE) Network Workshop)
  • Article
  • Open Access
3 Citations
1,605 Views
37 Pages

A Hybrid NER–Sentiment Model for Uzbek Texts: Integrating Lexical, Deep Learning, and Entity-Based Approaches

  • Bobur Saidov,
  • Vladimir Barakhnin,
  • Rakhmon Saparbaev,
  • Zayniddin Narmuratov and ,
  • Rustamova Manzura,
  • Ruzmetova Zilolakhon and
  • Anorgul Atajanova
  • + 2 authors+ 0 author

This work proposes a hybrid Uzbek sentiment analysis model (sometimes referred to as tonality analysis in the local literature) that integrates contextual text representations with named-entity information from an NER module and emoji-based emotional...

(This article belongs to the Section Data Mining and Machine Learning)
  • Article
  • Open Access
344 Views
24 Pages

17 September 2026

Multilingual sentiment analysis remains challenging because of cross-linguistic differences, uneven data availability, and potential shifts in meaning introduced during translation. Rather than proposing a new model, this study examines the performan...

  • Article
  • Open Access
530 Views
19 Pages

Test-Free Fault Localization Through Deep Source Code Analysis Using Encoder-Based Language Models

  • Jesus-Angel del-Hoyo-Gabaldon,
  • Antonio Garcia-Cabot,
  • Eva Garcia-Lopez and
  • David de-Fitero-Dominguez

17 July 2026

Fault Localization (FL) has evolved with the emergence of the Transformer architecture. Traditionally, FL relied on generating a ranking of suspiciousness scores for each code unit using information obtained during program execution from a set of tes...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
529 Views
22 Pages

20 April 2026

Full fine-tuning of pre-trained models sometimes requires inserting trainable layers into the middle of a pre-trained backbone, but such middle-layer insertion can severely degrade downstream performance. We hypothesize that this degradation arises b...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
1 Citations
1,742 Views
22 Pages

From Patient Emotion Recognition to Provider Understanding: A Multimodal Data Mining Framework for Emotion-Aware Clinical Counseling Systems

  • Saahithi Mallarapu,
  • Xinyan Liu,
  • Pegah Zargarian,
  • Seyyedeh Fatemeh Mottaghian and ,
  • Ramyashree Suresha,
  • Vasudha Jain and
  • Akram Bayat
  • + 2 authors+ 0 author

Computational analysis of therapeutic communication presents challenges in multi-label classification, severe class imbalance, and heterogeneous multimodal data integration. We introduce a bidirectional analytical framework addressing patient emotion...

(This article belongs to the Special Issue Recent Advances in Data Mining: Methods, Trends, and Emerging Applications)
  • Article
  • Open Access
3 Citations
2,511 Views
19 Pages

9 November 2023

In recent years, with the advancement of natural language processing techniques and the release of models like ChatGPT, how language models understand questions has become a hot topic. In handling complex logical reasoning with pre-trained models, it...

(This article belongs to the Special Issue AI for Computational Vision, Natural Language Processing, and Geoinformatics)
  • Article
  • Open Access
732 Views
29 Pages

14 February 2026

Stance detection has emerged as an essential tool in natural language processing for understanding how individuals express agreement, disagreement, or neutrality toward specific targets in social and online discourse. It plays a crucial role in bilin...

(This article belongs to the Special Issue Next-Generation Machine Learning and Deep Learning Models for Complex Data, Vision, and Intelligent Applications)
  • Article
  • Open Access
1 Citations
2,784 Views
30 Pages

Activation-Guided Layer Selection for LoRA

  • Aditya Dawadikar,
  • Pooja Shyamsundar,
  • Rashmi Vishwanath Bhat and
  • Navrati Saxena

12 March 2026

Low-Rank Adaptation (LoRA) has become a widely adopted parameter-efficient fine-tuning (PEFT) technique for large language models (LLMs). LoRA’s benefits stem from its light weight and modular adapters. Standard LoRA applies adapters uniformly...

(This article belongs to the Special Issue Modeling in the Era of Generative AI)

of 2