Skip to Content
SensorsSensors
  • Article
  • Open Access

22 November 2025

15 Pages

MLD-Net: A Multi-Level Knowledge Distillation Network for Automatic Modulation Recognition

,
,
,
,
,
and
1
Southwest China Institute of Electronic Technology, Chengdu 610036, China
2
Key Laboratory of Electronic Information Counter-Measure and Simulation, Xidian University, Xi’an 710071, China
3
The School of Aerospace Science and Technology, Xidian University, Xi’an 710071, China
*
Author to whom correspondence should be addressed.
This article belongs to the Section State-of-the-Art Sensors Technologies

Abstract

Automatic Modulation Recognition (AMR) is a critical technology for intelligent wireless communication systems, but the deployment of high-performance deep learning models is often hindered by their substantial computational and memory requirements. To address this challenge, this paper proposes a multi-level knowledge distillation network, namely MLD-Net, for creating a lightweight and powerful AMR model. Our approach employs a large Transformer-based network as a teacher to guide the training of a compact and efficient Reformer-based student model. The knowledge contained in the large model is transferred across three distinct granularities: at the output level, to convey high-level predictive distributions; at the feature level, to align intermediate representations; and at the attention level, to propagate relational information about signal characteristics. This comprehensive distillation strategy empowers the student model to effectively emulate the teacher’s complex reasoning processes. Experimental results on the RML2016.10A benchmark dataset demonstrate that MLD-Net achieves state-of-the-art performance, outperforming other baseline models across a wide range of signal-to-noise ratios while requiring only a fraction of the parameters. Extensive ablation study further confirms the collaborative contribution of each distillation level, validating that the proposed MLD-Net is an effective solution for developing lightweight and efficient AMR networks for edge deployment.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.