Next Article in Journal
Large Language Model Benchmarks: A Taxonomy of Capabilities, Scientific Quality Assessment, and Saturation Analysis
Previous Article in Journal
A Directional Semantic Enhancement Approach with Gated Fusion for Multimodal Arabic Sentiment Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Unnoticeable Hybrid Watermarking for Deep Neural Network Authentication Using Auxiliary Hidden Layers

by
Rodrigo Eduardo Arevalo-Ancona
and
Manuel Cedillo-Hernandez
*
Sección de Estudios de Posgrado e Investigación Escuela Superior de Ingeniería Mecánica y Eléctrica (SEPI ESIME) Culhuacan, Instituto Politécnico Nacional, Mexico City 04440, Mexico
*
Author to whom correspondence should be addressed.
Mach. Learn. Knowl. Extr. 2026, 8(6), 140; https://doi.org/10.3390/make8060140
Submission received: 28 April 2026 / Revised: 19 May 2026 / Accepted: 20 May 2026 / Published: 22 May 2026
(This article belongs to the Section Safety, Security, Privacy, and Cyber Resilience)

Abstract

The authentication and protection of deep neural network models have become challenging due to their widespread distribution and reuse, making them vulnerable to unauthorized access. This paper addresses the need for ownership verification by proposing a hybrid neural network watermarking method for secure model authentication. The approach combines a steganographic watermark embedded into stable model weights with a user code for watermark recovery encoded in auxiliary hidden layers. Stable parameters are identified through a reduced training to estimate gradient variations for the watermark insertion with minimal impact on model performance. Additionally, two auxiliary layers are introduced, to store in the first layer the metadata indices from the selected weights where the watermark was embedded and in the second layer the user code, supporting secure identification and verification. Experimental evaluations demonstrate that the proposed method remains robust under different model optimization attacks, including pruning, fine-tuning, additive noise injection, and parameter overwriting, while preserving model performance. The proposed framework achieves a BER = 0 under several moderate attack scenarios across different neural network models, whereas more aggressive optimizations degrade the watermark recovery performance. These results indicate that the proposed framework provides an effective solution for neural network ownership protection while maintaining the model performance.

1. Introduction

The development of artificial intelligence models based on neural networks has expanded across most research areas, facilitating their distribution and reuse. However, this situation has increased the risk of unauthorized use. Therefore, it is necessary to develop effective protection and authentication mechanisms for trained neural network models [1,2,3].
In this context, neural network protection techniques are commonly classified into white-box and black-box approaches. White-box techniques have full access to the model architecture and parameters, which are used to embed or extract ownership information [4,5,6]. In contrast, black-box approaches operate with restricted access, limiting the interaction to input–output information for model authentication [7,8,9].
Despite their effectiveness, both methods may present limited robustness and imperceptibility. Several existing methods show a performance degradation due to the embedding of ownership information. Furthermore, these techniques face some challenges during model optimizations such as fine-tuning, pruning, or quantization [10,11,12,13].
For this reason, it is necessary to develop unnoticeable watermarking methods for neural network authentication that preserve model performance while ensuring robustness. To address this challenge, this paper presents a hybrid white-box approach that combines two complementary mechanisms. First, a watermark is embedded into selected stable weights, intentionally designed to enable manipulation detection. Second, an authentication mechanism based on auxiliary hidden layers is introduced to ensure reliable ownership verification under model optimization attacks. The weight watermarking process relies on the identification of the most stable layers and weights through gradient analysis under a simulated reduced fine-tuning procedure, which allows for selecting parameters with minimal variation.
Unlike our previous work [14], which embedded ownership information by directly replacing a single bit within the IEEE 754 floating-point representation of selected weights, the proposed method adopts a structured binary decomposition of the weights and integrates auxiliary hidden layers to strengthen authentication reliability and robustness.
Specifically, two auxiliary layers are incorporated into the trained architecture. The first auxiliary layer encodes the indices of the selected stable layers and weights, for localization during the verification process without requiring gradient computation. The second auxiliary layer stores a user code generated through a modular addition (mod 2) between the binary representation of the selected weights and the watermark sequence. This hybrid design enhances robustness against neural network optimizations while preserving model performance. The main contributions of this paper consist of:
  • A hybrid watermarking scheme that integrates an unnoticeable watermark embedded into stable model weights for manipulation detection, combined with a robust authentication based on auxiliary hidden layers, for ownership verification under model optimization attacks.
  • An unnoticeable watermarking scheme is presented to embed ownership information into selected stable weights of the neural network, preserving the performance of the model.
  • A criterion for the selection of stable layers and weights is established through a gradient-based analysis conducted under a simulated reduced training process. This approach identifies the weights and layers with minimal variation, reducing randomness in the selection process.
  • Auxiliary hidden layers are incorporated into the trained architecture to encode and store the indices of the selected stable layers and weights. This design facilitates the watermark extraction during the authentication stage, contributing to improved efficiency and robustness against fine-tuning optimizations.
  • A user code for authentication is embedded by means of a modular addition operation between the binary representation of the selected stable weights and the watermark. This modular encoding strategy enhances the robustness against common optimizations, including fine-tuning, pruning, noise injection, and bit overwriting.
To contextualize these contributions, the following section provides a comprehensive review of existing neural network watermarking and protection methods.

2. Literature Review

Existing approaches for neural network watermarking and protection depend on the level of model access, watermark embedding strategies, and authentication mechanisms, with a focus on robustness against different model optimizations.
Early studies have demonstrated that neural network models can be effectively manipulated for its protection even under black-box access, as presented by Leroux et al. [15], who generated embedding keys by clustering internal activations and optimizing input samples near the decision boundary. Yadollahi et al. [16] embed the watermark by introducing a trigger composed by modified input samples associated with incorrect labels. Luo et al. [17] embedded the watermark into input images using a generative adversarial network (GAN) trained with the classification model. The model is designed to recognize only the watermark embedded images. Liu et al. [18] generate unnoticeable perturbations in the Discrete Fourier Transform, combined with trigger patterns, to create dedicated watermark classes. The watermark is verified through the model response to the perturbed inputs. Li et al. [19] modify the training of the neural network to embed a watermark into the activation functions. A Power Function Mapping is applied to smooth the activations. Zhang et al. [20] embed a watermark into neural networks using a set of triggers, where each trigger encodes a single bit.
Moreover, other studies have explored watermarking schemes under white-box access using internal parameters. Bellafqira and G. Coatrieux [21] proposed DICTION to embed the watermark into the activation maps from the hidden layers. Furukawa et al. [22] proposed a weight regularization during training. Then, the watermark is embedded into the convolutional layer weights with a predefined binary pattern generated using a secret key. Zheng and Ren [23] embed the watermark information into feature maps during training using convolutional kernels. Fei et al. [24] introduce a watermarking approach for generative models that embeds ownership information during training by enforcing convergence toward a wide flat minimum through an additional watermarking loss.
Table 1 summarizes representative neural network watermarking methods, highlighting their model access, embedding domains, use of auxiliary components, and main limitations.

3. Materials and Methods

3.1. Materials

The method was implemented on a system equipped with an Intel Core i7 processor (Intel Corporation, Santa Clara, CA, USA) and an NVIDIA GeForce RTX 4060 GPU (NVIDIA Corporation, Santa Clara, CA, USA). For the experimental setup, two approaches were considered. First, an inpainting-based segmentation model was utilized using the IMD2020 dataset [25]. Second, a classification model was trained and evaluated on the MNIST dataset to assess its performance on an image classification task. All experiments were implemented in Python v3.10 using PyTorch v2.1 and CUDA v12.1.

3.2. Proposed Deep Neural Network Authentication

The proposed method focuses on the authentication of neural networks using a hybrid watermarking scheme. An unnoticeable watermark is embedded into the most stable weights for forgery detection while auxiliary layers are employed to store user information for the authentication. Figure 1 illustrates the architecture of the proposed method. The proposed method is divided into five stages:
  • Stable layers and weights extraction;
  • Watermark embedding;
  • User code generation;
  • Auxiliary storage;
  • Neural network authentication.

3.2.1. Stable Layers and Weights Extraction

To minimize the impact of watermark embedding on model performance and to ensure reliable recovery, it is crucial to select the most stable layers and weights. Weight stability is measured during training with the gradient, to identify the parameters with minimal changes. These stable weights are used for an unnoticeable watermark embedding.
For this purpose, a simulated training is performed to estimate the expected changes in the weights. A reduced dataset X s and a limited number of epochs are used in this simulation. The reduced training setup uses the same dataset as the main experiment and employs the Adam optimizer with a learning rate of 1 × 10−4, batch size of 64, and a limited training range of 1–5 epochs. During this process, the weight w i , j of layer i is updated w i , j as in (1):
w i j = w i j η L s w i j
where η is the learning rate and Ls is the loss function that evaluates X s . The stability of each weight is evaluated using its gradient g, calculated in (2), as it indicates how sensitive the weight is to changes during training. Weights with smaller gradient magnitudes have minimal changes and are considered more stable [26,27,28,29].
g = w i j η | L w i j |
The gradients are computed for the original trained weights and the weights for the simulated training process. To analyze parameter stability, the variation Δ between the original gradient gt and the simulated gradient gs is calculated in (3).
g = | g s g t |
Then, the layer stability is calculated with the average gradient from the weights in (4).
S i = 1 n i j = 1 n i g i j
The 74 most stable weights from the most stable layers are selected for watermark embedding. These weights are subsequently transformed into a binary representation.

3.2.2. Watermark Embedding

After selecting the stable weights, a binary representation is constructed. Unlike the IEEE-754 floating-point representation, the proposed encoding strategy does not employ exponent normalization or floating-point scaling operations. Instead, the original parameter value is represented using a structured binary encoding specifically designed for watermark embedding. This representation enables watermark insertion at predefined bit positions while preserving the numerical consistency of the original weight during the embedding and extraction processes.
Each weight is decomposed into three components: the sign bit, the integer component integer, and the binary representation of the fractional part f in (5) and (6).
w I n t e g e r . f l o a t
w ( s i g n , I n t e g e r , b i n a r y f l o a t )
where the sign bit { 0 , 1 } , and the binary vector has a length of 32 bits. The sign bit is defined in (7).
s i g n = 0 i f w < 0 1 i f w 0
The fractional f is quantized using 32 bits in (8):
d = | f 2 32 |
The binary vector b = { b 1 , b 2 ,   , b 32 } is obtained by expressing d as its binary representation. Therefore, the watermark w m is embedded into the selected bit position k { 1 ,   ,   32 } , defining the watermarked binary weight as b′ in (9).
b = 1 i f w m = 0 b i f w m = 1
Therefore, the inverse process is applied to reconstruct the weights in their decimal form, to use them on the neural network, in (10).
d r = k = 1 32 b k 2 32 k
Then, the float part is recovered in (11).
f r = d 2 32
Finally, the watermarked weight is obtained as
w r = ( 1 ) s i g n ( I n t e g e r + f r )
The watermark embedding process does not alter the weight distribution and preserves the original performance of the neural network.

3.2.3. User Code Generation

The user code is generated from the interaction between the watermark and the model weight parameters and is used as a model-dependent authentication element. The stable weights act as a pseudo-random sequence that is difficult to reproduce, even under identical training conditions.
The combination of the watermark w m = ( w m 1 , w m 2 , , w m L ) and the binary stable weights b w = ( b w 1 , b w 2 , , b w L ) creates the user code, which introduces an additional randomness. This strategy increases the robustness against model modifications while preserving network performance. In this stage, each stable weight is binarized according to its sign, as in (13).
b w = 0 i f w < 0 1 i f w 0
Thus, the user code u c is generated using the addition module 2 [30,31,32], ensuring a reversible encoding, in (13) and (14):
u c = ( b w k + w m k ) mod ( 2 ) k = 1 , , L
where L is the length sequence. This encoding links the watermark to the neural network model, generating an efficient authentication.

3.2.4. Auxiliary Storage

Auxiliary layers are incorporated into the trained neural network to store auxiliary authentication data. These layers are hidden in the architecture and do not interact with the inference, ensuring that the original task and performance of the network remain unaffected.
The first auxiliary layer Aux1 encodes the indices of the stable layers l i   i = 1, …, 4 and weights w i , j j = 1, …, 75 used during the watermark embedding in (15).
A u x 1 = { ( l 1 , w 1 , 1 , w 1 , 2 , , w 1 , 75 ) , ( l 2 , w 2 , 1 , w 2 , 2 , , w 2 , 75 ) , , ( l 4 , w 4 , 1 , w 4 , 2 , , w 4 , 75 ) }
The index embedding improves the robustness of the method and facilitates the localization of the watermarked weights, thereby increasing the effectiveness of the watermark extraction process. The second auxiliary layer Aux2 is used to store the user code, eliminating the need for storage on an external device, as in (16).
A u x 2 = { u c 1 , , u c L }
The introduction of auxiliary storage layers provides an efficient mechanism for preserving authentication information. Moreover, embedding information on the neural network eliminates the need for external metadata or secret files, reducing the risk of information loss or tampering. This method does not assume perfect invisibility of the auxiliary layers under unrestricted white-box access. Its security relies on the absence of explicit architectural exposure, unless there is prior knowledge of the embedding locations and retrieval procedure.

3.2.5. Neural Network Authentication

The architecture authentication process is illustrated in Figure 2 and in Algorithm 1, where the extraction of both watermarks is represented.
During the watermark extraction, the indices from the stable layers l i , i   =   1 , , 4 , and their corresponding weights w ( i , j ) , j = 1 , , 74 used for watermark embedding, are retrieved from the auxiliary layer, as in (17).
A u x 1 = { ( l 1 , w 1 , 1 , w 1 , 2 , , w 1 , 75 ) , ( l 2 , w 2 , 1 , w 2 , 2 , , w 2 , 75 ) , , ( l 4 , w 4 , 1 , w 4 , 2 , , w 4 , 75 ) }
For each selected stable weight, the same decomposition process used during embedding is applied to obtain its fractional component f, which is quantized using 32 bits, as shown in (5)–(8). Therefore, the watermark is obtained from the embedded bit position m, as in (18).
w m = b m , m { 1 , , 32 }
Then, the neural network is authenticated using the user code stored in the second auxiliary layer Aux 2 . The embedded watermark associated with the user code is retrieved by applying the inverse modulo-2 addition operation defined in (19), combining the binarized weights b w = ( b w 1 , b w 2 , , b w L ) represented in (13) and the user code uc.
w m = ( b w k + u c k ) mod ( 2 )
Algorithm 1. Watermark retrieval process.
Input:
  Neural network N,
  stable layer indices li,
  embedded bit position m,
  user code uc
Output:
  Recovered ownership watermark W,
  recovered authentication watermark A
1: Retrieve stable layers li from Aux2
2: for each selected weight w(i,j) in li do
3:   Compute the fractional component f
4:   Quantize f using 32-bit representation
5:   Extract the embedded bit from position m
6:   Store the extracted bit into W
7: end for
8: Retrieve the binarized weights bw
9: Recover authentication watermark:
          A = bw’ ⊕ uc
10: Return W and A
The proposed extraction procedure recovers both watermarks by reproducing the transformation steps used during embedding. Together, these mechanisms enable an accurate ownership authentication, even under common neural network optimization operations.

4. Results

This section evaluates the proposed hybrid watermarking method under different experimental scenarios to assess its effectiveness, robustness, and impact on model performance. To evaluate its applicability across different neural network models, two architectures were employed (Figure 3 and Figure 4).
The MNIST dataset was used to assess performance in an image classification task.
Additionally, the embedded watermark consists of four pseudo-random binary sequences, where each sequence contains 74 bits and is inserted into four distinct stable layers previously selected through the gradient-based stability analysis.
The auxiliary layers are intentionally disconnected from the computational graph of the neural network. They are excluded from both forward and backward propagation processes and do not participate in the inference, loss computation, or gradient-based optimization. Consequently, their presence does not interfere with the learning, convergence, or predictive performance of the model.
These layers were employed as storage structures, and their dimensionality can be flexibly defined according to the required payload size, without imposing architectural modifications or additional computational overhead on the primary network.
The accuracy was used as for the MNIST classification evaluation. In the case of the inpainting segmentation model, accuracy and mean squared error (MSE) were employed to assess forged pixel prediction. These metrics illustrate the impact of the watermark embedding and auxiliary layers on the inference performance from each neural network. Moreover, the bit error rate (BER) was used to evaluate watermark recovery from the network parameters by measuring the portion of different bits between the original and the retrieved sequences. The retrieved watermark is considered successfully recovered when the extracted sequence remains structurally identifiable with respect to the original watermark. Lower BER values indicate higher recovery fidelity and improved robustness against distortions. In the proposed framework, the recovered watermark patterns preserve recognizable structural information and remain distinguishable from unrelated watermark sequences, even under different image distortions and manipulations.

4.1. Impact of Watermark Embedding on Model Performance

To evaluate watermark imperceptibility and neural network performance, the models were analyzed before and after watermark embedding. The watermark embedding was performed using the 13-bit position to ensure a stable encoding without affecting model performance. The evaluation focuses on verifying that the proposed method does not degrade predictive accuracy while maintaining watermark integrity. Table 2 summarizes the quantitative results for each architecture.
Table 2 and Figure 5 demonstrate minimal changes between the original and watermarked models. Table 2 shows that the impact of the watermark on the neural network performance is less than 0.1%. On the other hand, Figure 5 illustrates the weight distributions of the original and watermarked models. These results demonstrate the imperceptibility of the proposed watermarking method. The quantitative evaluation of the weight distribution for the original and watermarked models is presented in Table 3.
Table 3 shows the preservation of the statistics from the weights of the neural networks, demonstrating that the embedding process does not perturb the parameters. The Wasserstein distance validates the comparison of the statistical distributions.

4.2. Robustness and Authentication Analysis

To assess robustness, the proposed method was evaluated under different optimization attacks. Table 4 presents the watermark recovery and authentication performance, evaluated in terms of the BER defined as in (20):
B E R = 1 N i = 1 N ( w i w i )
where w and w’ are the original watermark and the retrieved watermark, respectively. Additionally, represents an XOR operation. The authentication is determined by the watermark retrieval error, where lower BER values indicate a successful recovery and values approaching 0.5 correspond to random reconstruction and failed authentication. The verification is performed directly at the bit-reconstruction level.
Table 4 evaluates the robustness of the two proposed authentication mechanisms independently. The watermark embedded into the selected stable weights is employed for ownership verification, while the user code stored in the auxiliary layers is designed for user authentication and traceability.
The results present the recovery performance of both watermarks under different optimization attacks, evaluated on two different neural network architectures. As expected, the watermark embedded into the selected stable weights is sensitive to parameter modifications, which increase the BER under fine-tuning, pruning, and Gaussian noise injection.
In contrast, the watermark from the user code is recoverable across most optimization attacks, exhibiting a low BER and reliable authentication. However, for pruning rates above 25%, the recovery of the robust watermark may degrade, since the removal of weights involved in the user code generation can compromise the watermark reconstruction. Finally, LSB bit overwriting does not significantly affect watermark recovery, as this manipulation introduces minimal variations in the weight parameters and does not interfere with watermark retrieval.
For a more explicit interpretation of watermark reconstruction performance, Table 5 additionally reports the number of correctly and incorrectly recovered bits under different attack scenarios.
Figure 6 illustrates the impact of the learning rate during fine-tuning on watermark recovery in both models. In the classification network, the watermark shows a high initial BER of 0.44 for a learning rate of 0.001 and the watermark recovery BER decreases when the learning rate is lower. The robust watermark, however, achieves complete recovery (BER = 0) under moderate learning rates. In the inpainting model, the watermark remains stable with a BER recovery of 0.23–0.24 across all learning rates. Overall, these results highlight the proposed hybrid scheme.

4.3. Payload Capacity

The payload capacity of the proposed watermarking technique is evaluated by changing the amount of embedded information and the number of layers used for insertion. The assessment considers both the impact on model accuracy and the robustness of watermark recovery under different insertion configurations.
Table 6 illustrates the impact of increasing the watermark payload on model performance maintaining a stable performance accuracy, indicating that the information embedding does not affect the learned representations. Furthermore, both watermarks remain detectable and recoverable, achieving a BER of 0 across all evaluated configurations. These results demonstrate that the proposed method supports higher embedding capacities without compromising performance or recoverability.
The number of selected stable weights is determined by the payload size required for watermark embedding. Consequently, the proposed framework can be adapted to different embedding capacities; the only condition is that the selected layers contain a sufficient number of stable parameters for reliable information storage.

4.4. Method Comparison

The effectiveness of the proposed hybrid watermarking scheme is evaluated through a comparative analysis with representative methods reported in the literature. The comparison considers the watermark embedding strategy, payload capacity, robustness against common optimization attacks, and watermark recovery performance. This analysis highlights the advantages of the proposed method in terms of watermark detection and ownership authentication.
Table 7 presents a comparison between existing neural network watermarking methods and the proposed approach in terms of payload capacity, baseline performance, and robustness against optimization attacks. Most existing methods are evaluated exclusively on classification models, particularly using the MNIST dataset, which limits the assessment of their generalization across different tasks and architectures. In contrast, this work was evaluated on two distinct models: one for image classification and another for segmentation. This experimental validation demonstrates adaptability and applicability across different architectures and objectives.
The compared methods are evaluated on different datasets, including, which vary in complexity, resolution, and domain characteristics. However, in the proposed approach, the watermark is embedded directly into model parameters. Therefore, dataset differences do not significantly affect the embedding or extraction performance in our method.
The proposed method achieves a higher payload capacity (296–740 bits) while preserving stable inference performance. In addition, a BER of 0 is obtained for watermark recovery under baseline conditions. Moreover, it shows robustness against fine-tuning, Gaussian noise injection, pruning, and bit overwriting attacks.
Nevertheless, the method is sensitive to quantization. Since the watermark is embedded at the bit level of floating-point weights, quantization may remove or alter the modified bits by changing the numerical precision and binary representation of the parameters, which can make the watermark recovery difficult.

5. Discussion

The experimental results highlight the effectiveness of the proposed hybrid watermarking method for neural networks. The watermark embedded in stable weights exhibits high sensitivity to optimizations, such as fine-tuning, pruning, and noise injection. In contrast, the watermark from the user code embedded into the auxiliary layer demonstrates a consistent retrieval process across different optimizations, ensuring an efficient ownership verification. This design preserves accuracy and the model performance. Furthermore, the payload can be increased without performance degradation.
However, the sensitivity to quantization exposes a limitation of bit-level watermarking in floating-point representations. Since quantization modifies the precision and binary structure of weights, it may disrupt the embedded information. Overall, the results demonstrate that the proposed method provides a balanced and effective solution for neural network ownership authentication, although further improvements are required. Future work will focus on the design of adaptive and structure embedding strategies to enhance robustness against quantization, as well as extend the evaluation to large architectures and adversarial optimized environments. Embedding information in numerically stable regions of the floating-point format, it may be possible to increase robustness over conventional direct bit-level modification.

6. Conclusions

This work proposes a neural network protection method based on a hybrid watermarking strategy. The watermark is embedded directly into selected model weights, while the indices of the modified layers and parameters are stored in an auxiliary layer in parallel. On the other hand, the second watermark is implemented by storing a user code in a second auxiliary layer. This user code is generated by combining the watermark sequence with the binarized weights according to their sign, enabling consistent and model-dependent ownership verification.
Experimental results demonstrate that the proposed method achieves a BER of 0 for the user code watermark recovery under common optimization procedures, including fine-tuning, pruning, Gaussian noise injection, and LSB bit overwriting. Furthermore, increasing the payload does not degrade the inference performance of the model, confirming that the embedded information does not interfere with learned representations or training dynamics.
The approach also demonstrates generality by being validated on two different neural network architectures designed for distinct tasks, showing consistent behavior in terms of imperceptibility, robustness, manipulation detection, and watermark recovery. However, sensitivity to quantization is observed, since modifications in the binary representation of floating-point weights may compromise watermark reconstruction. Since quantization modifies the precision and binary structure of weights by modifying the embedded information. Future work will focus on the design of adaptive and structure embedding strategies to enhance robustness against quantization. Embedding information in numerically stable regions of the floating-point format, it may be possible to increase the robustness over conventional direct bit-level modification.

Author Contributions

Conceptualization, R.E.A.-A. and M.C.-H.; methodology, R.E.A.-A.; software, R.E.A.-A.; validation, R.E.A.-A.; formal analysis, R.E.A.-A. and M.C.-H.; investigation, R.E.A.-A.; data curation, M.C.-H.; writing R.E.A.-A.; review and editing, M.C.-H.; visualization, M.C.-H.; supervision, M.C.-H.; funding acquisition, M.C.-H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Secretaría de Ciencia, Humanidades, Tecnología e Innovación (SECIHTI) of Mexico with grant numbers 744415 and 161591, as well as by the Secretaría de Investigación y Posgrado of the Instituto Politécnico Nacional, which provided financial support for the development of this work.

Data Availability Statement

The dataset used in this study is publicly available and has been cited in the manuscript [25]. It can be accessed through the official repository provided by the authors: https://staff.utia.cas.cz/novozada/db/ (Accessed 27 April 2026).

Acknowledgments

The authors thank the Secretaría de Ciencia, Humanidades, Tecnología e Innovación (SECIHTI) of Mexico and the Instituto Politécnico Nacional for the financial support provided during the realization of this research.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
GANGenerative adversarial network
BERBit error rate
MSEMean squared error

References

  1. Li, F.-Q.; Wang, S.-L.; Zhu, Y. Measure and countermeasure of the capsulation attack against backdoor-based deep neural network watermarks. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 4–10 June 2023; IEEE: Piscataway, NJ, USA, 2023. [Google Scholar] [CrossRef]
  2. Gupta, M.; Kishore, R.R. A survey of watermarking technique using deep neural network architecture. In Proceedings of the 2021 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), Greater Noida, India, 19–20 February 2021; IEEE: Piscataway, NJ, USA, 2021. [Google Scholar] [CrossRef]
  3. Adeyemo, A.A.; Hasan, S.R. Enhancing the security of collaborative deep neural networks: An examination of the effect of low pass filters. In Proceedings of the Great Lakes Symposium on VLSI (GLSVLSI 2023), Knoxville, TN, USA, 5–7 June 2023; Association for Computing Machinery: New York, NY, USA, 2023; pp. 461–465. [Google Scholar] [CrossRef]
  4. Li, Y.; Wang, H.; Barni, M. A survey of deep neural network watermarking techniques. Neurocomputing 2021, 461, 171–193. [Google Scholar] [CrossRef]
  5. Li, F.-Q.; Wang, S.-L.; Zhu, Y. Fostering the robustness of white-box deep neural network watermarks by neuron alignment. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore, 23–27 May 2022; IEEE: Piscataway, NJ, USA, 2021; pp. 3049–3053. [Google Scholar] [CrossRef]
  6. Lee, E.S.; Jo, H.; Hwang, H.J. Reverse engineering for programmable logic controller structure estimation via white box networks. J. Intell. Manuf. 2025, in press. [Google Scholar] [CrossRef]
  7. Hu, X.; Liu, G.; Zheng, B.; Zhao, L.; Wang, Q.; Zhang, Y.; Du, M. FastTextDodger: Decision-based adversarial attack against black-box NLP models with extremely high efficiency. IEEE Trans. Inf. Forensics Secur. 2024, 19, 2398–2411. [Google Scholar] [CrossRef]
  8. Zhu, R.; Zhang, X.; Shi, M.; Tang, Z. Secure neural network watermarking protocol against forging attack. J. Image Video Process. 2020, 2020, 37. [Google Scholar] [CrossRef]
  9. Okada, S.; Jmila, H.; Akashi, K.; Mitsunaga, T.; Sekiya, Y.; Takase, H.; Blanc, G.; Nakamura, H. XAI-driven black-box adversarial attacks on network intrusion detectors. Int. J. Inf. Secur. 2025, 24, 103. [Google Scholar] [CrossRef]
  10. Alobaid, A.; Bonny, T.; Alrahhal, M. Disruptive attacks on artificial neural networks: A systematic review of attack techniques, detection methods, and protection strategies. Intell. Syst. Appl. 2025, 26, 200529. [Google Scholar] [CrossRef]
  11. Adesuyi, T.A.; Kim, B.M. A neuron noise-injection technique for privacy preserving deep neural networks. Open Comput. Sci. 2020, 10, 137–152. [Google Scholar] [CrossRef]
  12. Xu, G.; Li, H.; Ren, H.; Yang, K.; Deng, R.H. Data security issues in deep learning: Attacks, countermeasures, and opportunities. IEEE Commun. Mag. 2019, 57, 116–122. [Google Scholar] [CrossRef]
  13. Akers, M.; Barton, A. Forming adversarial example attacks against deep neural networks with reinforcement learning. Computer 2024, 57, 88–99. [Google Scholar] [CrossRef]
  14. Arevalo-Ancona, R.E.; Cedillo-Hernandez, M. Intellectual property protection of neural network architectures via steganography and IEEE 754 standard. Appl. Comput. Inform. 2025, 1–15. [Google Scholar] [CrossRef]
  15. Leroux, S.; Vanassche, S.; Simoens, P. Multi-bit, black-box watermarking of deep neural networks in embedded applications. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 16–22 June 2024; IEEE: Piscataway, NJ, USA, 2024. [Google Scholar] [CrossRef]
  16. Yadollahi, M.M.; Shoeleh, F.; Dadkhah, S.; Ghorbani, A.A. Robust black-box watermarking for deep neural network using inverse document frequency. In Proceedings of the IEEE International Conference on Dependable, Autonomic and Secure Computing/Pervasive Intelligence and Computing/Cloud and Big Data Computing/Cyber Science and Technology Congress, 25–28 October 2021; IEEE: Piscataway, NJ, USA, 2021. [Google Scholar] [CrossRef]
  17. Luo, Y.; Li, Y.; Zhang, S.; Liu, J.; Qin, S. A watermark-based framework to actively protect deep neural networks. In Proceedings of the International Joint Conference on Neural Networks (IJCNN), Yokohama, Japan, 30 June–5 July 2024; IEEE: Piscataway, NJ, USA, 2024. [Google Scholar] [CrossRef]
  18. Liu, Y.; Wu, H.; Zhang, X. Robust and imperceptible black-box DNN watermarking based on Fourier perturbation analysis and frequency sensitivity clustering. IEEE Trans. Dependable Secur. Comput. 2024, 21, 5766–5780. [Google Scholar] [CrossRef]
  19. Li, L.; Zhang, W.; Barni, M. Universal BlackMarks: Key-image-free black-box multi-bit watermarking of deep neural networks. IEEE Signal Process. Lett. 2023, 30, 36–40. [Google Scholar] [CrossRef]
  20. Zhang, H.; Li, F.-Q.; Wang, S.-L. Membership encoding for black-box neural network watermarking. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India, 6–11 April 2025; IEEE: Piscataway, NJ, USA, 2025. [Google Scholar] [CrossRef]
  21. Bellafqira, R.; Coatrieux, G. DICTION: DynamIC robust white box watermarking scheme for deep neural networks. Appl. Sci. 2025, 15, 7511. [Google Scholar] [CrossRef]
  22. Furukawa, R.; Sakazawa, S. Generation management of white-box DNN model watermarking. In Proceedings of the IEEE 12th Global Conference on Consumer Electronics (GCCE), Nara, Japan, 10–13 October 2023; IEEE: Piscataway, NJ, USA, 2023. [Google Scholar] [CrossRef]
  23. Zheng, M.; Ren, J. A high-load DNN watermarking scheme based on optimal embedding position. In Proceedings of the 5th International Conference on Big Data, Artificial Intelligence and Software Engineering (ICBASE), 20–22 September 2024; IEEE: Piscataway, NJ, USA, 2024. [Google Scholar] [CrossRef]
  24. Fei, J.; Xia, Z.; Tondi, B.; Barni, M. Wide flat minimum watermarking for robust ownership verification of GANs. IEEE Trans. Inf. Forensics Secur. 2024, 19, 8322–8337. [Google Scholar] [CrossRef]
  25. Novozamsky, A.; Mahdian, B.; Saic, S. IMD2020: A large-scale annotated dataset tailored for detecting manipulated images. In Proceedings of the IEEE Winter Applications of Computer Vision Workshops (WACVW), Snowmass Village, CO, USA, 1–5 March 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 71–80. [Google Scholar] [CrossRef]
  26. Manguri, A.; Jankowski, R.; Magisano, D. Gradient-based weight minimization of nonlinear truss structures with displacement, stress, and stability constraints. Int. J. Numer. Methods Eng. 2025, 126, e70096. [Google Scholar] [CrossRef]
  27. Xu, X.; Zhang, J.; Zhu, Q.; Xia, T. The influences of gradient color on the weight perception and stability perception: A preliminary study. i-Perception 2023, 14, 20416695231197797. [Google Scholar] [CrossRef] [PubMed]
  28. Hemanth Sai, B.; Mukherjee, S.; Dubey, S.R. Adaptive Adam-based optimizers using second-order weight decoupling and gradient-aware weight decay for vision transformer. Mach. Vis. Appl. 2025, 36, 68. [Google Scholar] [CrossRef]
  29. Wu, W.; Tu, F.; Li, X.; Wei, S.; Yin, S. SWG: An architecture for sparse weight gradient computation. Sci. China Inf. Sci. 2024, 67, 122405. [Google Scholar] [CrossRef]
  30. Ji, S.; Jiang, Z.; Zuo, J.; Fang, M.; Chen, Y.; Jin, T.; Zhao, Z. Speech watermarking with discrete intermediate representations. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI’25); PKP Publishing Services: Burnaby, BC, Canada, 2025; pp. 24239–24247. [Google Scholar] [CrossRef]
  31. Wang, S.-J. Steganography of capacity required using modulo operator for embedding secret image. Appl. Math. Comput. 2005, 164, 99–116. [Google Scholar] [CrossRef]
  32. Al-Dhamari, A.K.; Darabkh, K.A. Block-based steganographic algorithm using modulus function and pixel-value differencing. J. Softw. Eng. Appl. 2017, 10, 333–350. [Google Scholar] [CrossRef]
  33. Arevalo-Ancona, R.E.; Cedillo-Hernandez, M. Inpainting detection via image segmentation with a modified U-Net architecture. In Proceedings of the 6th International Conference on Communications, Information, Electronic and Energy Systems (CIEES), Ruse, Bulgaria, 26–28 November 2025; IEEE: Piscataway, NJ, USA, 2025. [Google Scholar] [CrossRef]
Figure 1. Overview of proposed method.
Figure 1. Overview of proposed method.
Make 08 00140 g001
Figure 2. Watermark retrieval process.
Figure 2. Watermark retrieval process.
Make 08 00140 g002
Figure 3. Inpainting detection via semantic segmentation architecture (Reprinted with permission from [33]).
Figure 3. Inpainting detection via semantic segmentation architecture (Reprinted with permission from [33]).
Make 08 00140 g003
Figure 4. MNIST classification model.
Figure 4. MNIST classification model.
Make 08 00140 g004
Figure 5. Histogram distributions of network weights: (a) inpainting architecture with original weights; (b) inpainting architecture with watermarked weights; (c) classification architecture with original weights; (d) classification architecture with watermarked weights.
Figure 5. Histogram distributions of network weights: (a) inpainting architecture with original weights; (b) inpainting architecture with watermarked weights; (c) classification architecture with original weights; (d) classification architecture with watermarked weights.
Make 08 00140 g005
Figure 6. Impact of learning rate in fine-tuning during watermark recovery process (a) Segmentation model. (b) Classification model.
Figure 6. Impact of learning rate in fine-tuning during watermark recovery process (a) Segmentation model. (b) Classification model.
Make 08 00140 g006
Table 1. Deep learning watermarking methods summarized.
Table 1. Deep learning watermarking methods summarized.
MethodYearModel AccessEmbedding
Domain
Auxiliary
Components
Limitations
[15]2024Black-boxTriggers/
Boundaries decision
Make 08 00140 i001 TriggersActivation functions dependency and decision boundary stability
[16]2021Black-boxTrigger-based behavior (implicit in weights)Make 08 00140 i001 TriggersWatermark depends on trigger set design
[17]2024Black-boxInput dataMake 08 00140 i001 GANDepends on the input data
[18]2024Black-boxInput data/TriggersMake 08 00140 i002Limited robustness against fine-tuning, pruning, or image distortions watermark
[19]2023Black-boxActivation functionsMake 08 00140 i002Depends on PF-Mapping design
[20]2025Black-boxTriggersMake 08 00140 i002Requires loss functions to avoid degrading the performance
[21]2025White-boxActivation functions and triggersMake 08 00140 i001 Projection networkRequires joint training and an additional network
[22]2023White-boxConvolutional layersMake 08 00140 i002Limited watermark payload
[23]2024White-boxFeature maps via convolutional kernelsMake 08 00140 i002Requires access to activation functions and convolutional layers
[24]2024White-boxWide flat minimum-based watermarkingMake 08 00140 i002Requires retraining of the generative model and is limited to generative architectures
Make 08 00140 i001 Has auxiliary components Make 08 00140 i002 Does not have auxiliary components. Most of the methods employ specific activation functions and trigger mechanisms as auxiliary elements for network protection. The incorporation of additional components such as new layers and the embedding of information within the model generates an effective model authentication.
Table 2. Impact of watermark embedding on neural network performance.
Table 2. Impact of watermark embedding on neural network performance.
ArchitectureMetricOriginal PerformanceWatermarked
Performance
Difference  
ClassificationAccuracy98.5%98.5%<0.1%
InpaintingAccuracy99.12%99.10%0.02%
MSE0.00870.00900.0003
Table 3. Quantitative distribution analysis.
Table 3. Quantitative distribution analysis.
ModelMean (After)Mean (Before)Standard Deviation (After)Standard Deviation (Before)Wasserstein Distance
Classification−0.0041−0.00410.03990.03993.2019 × 10−7
Inpainting−0.0100.0100.35990.35995.4955 × 10−9
Table 4. Robustness of proposed method.
Table 4. Robustness of proposed method.
Inpainting ModelClassification Model
AttacksBER (Watermark Embedded in Stable Weights)BER (Watermark Recover from the User Code)BER (Watermark Embedded in Stable Weights)BER (Watermark Recover from the User Code)
No attack0000
Fine-tuning 5 epochs0.2400.110
Fine-tuning 40 epochs0.2300.180
Gaussian noise addition σ = 0.020000
Gaussian noise addition σ = 0.090.110.470.530.51
Pruning 20%0000
Pruning 25%0000
Pruning 30%0.110.4700
Pruning 40%0.380.550.520.53
LSB bit overwriting0000
Quantization int 160000
Quantization int 80.440.560.370.49
Table 5. Detailed bit-level evaluation of watermark extraction performance.
Table 5. Detailed bit-level evaluation of watermark extraction performance.
No AttackPruning 20%Pruning 35%Quantization Int 16Quantization Int 8
TP7474417446
TN00000
FP00000
FN0033028
Table 6. Payload capacity analysis and watermark recovery performance.
Table 6. Payload capacity analysis and watermark recovery performance.
Watermarked LayersWatermarked Weights per LayerPerformanceBER (Watermark Embedded in Stable Weights)BER (Watermark Recover from the User Code)
5 layers74Accuracy = 99.10%
MSE = 0.0090
00
6 layers74Accuracy = 99.10%
MSE = 0.0090
00
10 layers74Accuracy = 99.10%
MSE = 0.0090
00
Table 7. Comparative analysis of the proposed and existing methods.
Table 7. Comparative analysis of the proposed and existing methods.
AuthorMethodDatasetPayloadBaseline PerformanceResistance to Optimization
Attacks
Li et al. [17]Black boxCIFAR10 and Fashion MNIST1–10 bitsBER = 0.08Fine-tuning
Quantization
Bellafqira and G. Coatrieux [20]White boxCaltech 101,
CIFAR 10 and CIFAR 100
256 bitsBER = 0Fine-tuning
Overwriting
Furukawa and Sakazawa [21]White boxCIFAR10 and MNIST64 bitsError = 4 bits---
Fei et al. [23]White boxNot mention100 bitsAccuracy = 96.8%Fine-tuning
Proposed MethodWhite boxMNIST and IMD2020 dataset296–740 bitsBER = 0Fine-tuning
Gaussian noise injection
Pruning
Overwriting
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Arevalo-Ancona, R.E.; Cedillo-Hernandez, M. Unnoticeable Hybrid Watermarking for Deep Neural Network Authentication Using Auxiliary Hidden Layers. Mach. Learn. Knowl. Extr. 2026, 8, 140. https://doi.org/10.3390/make8060140

AMA Style

Arevalo-Ancona RE, Cedillo-Hernandez M. Unnoticeable Hybrid Watermarking for Deep Neural Network Authentication Using Auxiliary Hidden Layers. Machine Learning and Knowledge Extraction. 2026; 8(6):140. https://doi.org/10.3390/make8060140

Chicago/Turabian Style

Arevalo-Ancona, Rodrigo Eduardo, and Manuel Cedillo-Hernandez. 2026. "Unnoticeable Hybrid Watermarking for Deep Neural Network Authentication Using Auxiliary Hidden Layers" Machine Learning and Knowledge Extraction 8, no. 6: 140. https://doi.org/10.3390/make8060140

APA Style

Arevalo-Ancona, R. E., & Cedillo-Hernandez, M. (2026). Unnoticeable Hybrid Watermarking for Deep Neural Network Authentication Using Auxiliary Hidden Layers. Machine Learning and Knowledge Extraction, 8(6), 140. https://doi.org/10.3390/make8060140

Article Metrics

Back to TopTop