Next Article in Journal
The Use of Perlite and Rhyolite in Concrete Mix Design: Influence on Physical-Mechanical and Environmental Performance
Previous Article in Journal
A Novel Dataset for Early Cardiovascular Risk Detection in School Children Using Machine Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

A Hybrid KAN-BiLSTM Transformer with Multi-Domain Dynamic Attention Model for Cybersecurity

by
Aleksandr Chechkin
1,
Ekaterina Pleshakova
2,* and
Sergey Gataullin
2,3
1
Department of Mathematics and Data Analysis, Financial University under the Government of the Russian Federation, 49 Leningradsky prospect, Moscow 125993, Russia
2
MIREA—Russian Technological University, 78 Vernadsky Avenue, Moscow 119454, Russia
3
Central Economics and Mathematics Institute of the Russian Academy of Sciences, Russia Nakhimovsky Prospect, 47, Moscow 117418, Russia
*
Author to whom correspondence should be addressed.
Technologies 2025, 13(6), 223; https://doi.org/10.3390/technologies13060223
Submission received: 15 February 2025 / Revised: 6 May 2025 / Accepted: 23 May 2025 / Published: 29 May 2025

Abstract

With the exponential growth of cyberbullying cases on social media, there is a growing need to develop effective mechanisms for its detection and prediction, which can create a safer and more comfortable digital environment. One of the areas with such potential is the application of natural language processing (NLP) and artificial intelligence (AI). This study applies a novel hybrid-structure Hybrid Transformer–Enriched Attention with Multi-Domain Dynamic Attention Network (Hyb-KAN), which combines a transformer-based architecture, an attention mechanism, and BiLSTM recurrent neural networks. In this study, a multi-class classification method is used to identify comments containing cyberbullying features. For better verification, we compared the proposed method with baseline methods. The Hyb-KAN model demonstrated high results on the multi-class classification dataset, achieving an accuracy of 95.25%. The synergy of BiLSTM, Transformer, MD-DAN, and KAN components provides flexibility and accuracy of text analysis. The study used explainable visualization techniques, including SHAP and LIME, to analyze the interpretability of the Hyb-KAN model, providing a deeper understanding of the decision-making mechanisms. In the final stage of the study, the results were compared with current research data to confirm their relevance to current trends.
Keywords: artificial intelligence; KAN; BiLSTM; cybersecurity; hybrid models; RNN artificial intelligence; KAN; BiLSTM; cybersecurity; hybrid models; RNN

Share and Cite

MDPI and ACS Style

Chechkin, A.; Pleshakova, E.; Gataullin, S. A Hybrid KAN-BiLSTM Transformer with Multi-Domain Dynamic Attention Model for Cybersecurity. Technologies 2025, 13, 223. https://doi.org/10.3390/technologies13060223

AMA Style

Chechkin A, Pleshakova E, Gataullin S. A Hybrid KAN-BiLSTM Transformer with Multi-Domain Dynamic Attention Model for Cybersecurity. Technologies. 2025; 13(6):223. https://doi.org/10.3390/technologies13060223

Chicago/Turabian Style

Chechkin, Aleksandr, Ekaterina Pleshakova, and Sergey Gataullin. 2025. "A Hybrid KAN-BiLSTM Transformer with Multi-Domain Dynamic Attention Model for Cybersecurity" Technologies 13, no. 6: 223. https://doi.org/10.3390/technologies13060223

APA Style

Chechkin, A., Pleshakova, E., & Gataullin, S. (2025). A Hybrid KAN-BiLSTM Transformer with Multi-Domain Dynamic Attention Model for Cybersecurity. Technologies, 13(6), 223. https://doi.org/10.3390/technologies13060223

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop