Next Article in Journal
Diverse Machine Learning-Based Malicious Detection for Industrial Control System
Previous Article in Journal
Session2vec: Session Modeling with Multi-Instance Learning for Accurate Malicious Web Robot Detection
Previous Article in Special Issue
Detection of Exoplanets in Transit Light Curves with Conditional Flow Matching and XGBoost
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

Multi-Head Hierarchical Attention Framework with Multi-Level Learning Optimization Strategy for Legal Text Recognition

1
Big Data Research and Development Center, North China Institute of Computing Technology, Beijing 100083, China
2
School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China
3
China Academy of Electronics and Information Technology, Beijing 100041, China
4
Strategic Planning Research Institute of CETC, Beijing 100041, China
5
China Justice Big Data Institute Co., Ltd., Beijing 100041, China
6
China Satellite Network Group Co., Ltd., Beijing 100020, China
*
Author to whom correspondence should be addressed.
Electronics 2025, 14(10), 1946; https://doi.org/10.3390/electronics14101946 (registering DOI)
Submission received: 31 March 2025 / Revised: 6 May 2025 / Accepted: 9 May 2025 / Published: 10 May 2025
(This article belongs to the Special Issue Image Processing Based on Convolution Neural Network: 2nd Edition)

Abstract

Owing to the rapid increase in the amount of legal text data and the increasing demand for intelligent processing, multi-label legal text recognition is becoming increasingly important in practical applications such as legal information retrieval and case classification. However, traditional methods have limitations in handling the complex semantics and multi-label characteristics of legal texts, making it difficult to accurately extract feature and effective category information. Therefore, this study proposes a novel multi-head hierarchical attention framework suitable for multi-label legal text recognition tasks. This framework comprises a feature extraction module and a hierarchical module. The former extracts multi-level semantic representations of text, while the latter obtains multi-label category information. In addition, this study proposes a novel hierarchical learning optimization strategy that balances the learning needs of multi-level semantic representation and multi-label category information through data preprocessing, loss calculation, and weight updating, effectively accelerating the convergence speed of framework training. We conducted comparative experiments on the legal domain dataset CAIL2021 and the general multi-label recognition datasets AAPD and Web of Science (WOS). The results indicate that the method proposed in this study is significantly superior to mainstream methods in legal and general scenarios, demonstrating excellent performance. The study findings are expected to be widely applied in the field of intelligent processing of legal information, improving the accuracy of intelligent classification of judicial cases and further promoting the digitalization and intelligence process of the legal industry.
Keywords: multi-head hierarchical attention; multi-level learning optimization strategy; legal text; multi-label recognition multi-head hierarchical attention; multi-level learning optimization strategy; legal text; multi-label recognition

Share and Cite

MDPI and ACS Style

Zhang, K.; Tu, Y.; Lu, J.; Ai, Z.; Liu, Z.; Wang, L.; Liu, X. Multi-Head Hierarchical Attention Framework with Multi-Level Learning Optimization Strategy for Legal Text Recognition. Electronics 2025, 14, 1946. https://doi.org/10.3390/electronics14101946

AMA Style

Zhang K, Tu Y, Lu J, Ai Z, Liu Z, Wang L, Liu X. Multi-Head Hierarchical Attention Framework with Multi-Level Learning Optimization Strategy for Legal Text Recognition. Electronics. 2025; 14(10):1946. https://doi.org/10.3390/electronics14101946

Chicago/Turabian Style

Zhang, Ke, Yufei Tu, Jun Lu, Zhongliang Ai, Zhonglin Liu, Licai Wang, and Xuelin Liu. 2025. "Multi-Head Hierarchical Attention Framework with Multi-Level Learning Optimization Strategy for Legal Text Recognition" Electronics 14, no. 10: 1946. https://doi.org/10.3390/electronics14101946

APA Style

Zhang, K., Tu, Y., Lu, J., Ai, Z., Liu, Z., Wang, L., & Liu, X. (2025). Multi-Head Hierarchical Attention Framework with Multi-Level Learning Optimization Strategy for Legal Text Recognition. Electronics, 14(10), 1946. https://doi.org/10.3390/electronics14101946

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop