4.1. Experimental Setup
All of the experiments have been conducted utilizing Jupyter Notebook version 7.0 on a high-performance server that is equipped with an NVIDIA RTX 4080 SUPER GPU (16 GB GDDR6X VRAM), 32 GB system RAM, and the Intel Core i7 processor operating at 2.66 GHz base frequency (with turbo boost up to 4.6 GHz). This setup provides sufficient computational resources for both training and evaluating the DNN models in order to effectively handle the datasets and attack simulations.
The employed datasets include different real-world DNN application scenarios, ranging from the high-dimensional image classification to the low-dimensional tabular medical data, which allows us to comprehensively assess the proposed attack’s generalization. The Date Fruit dataset (multiclass image classification) has been obtained from Kaggle [
47] and contains approximately 900 high-quality images for 7 date fruit varieties (Barhee, Deglet Nour, Sukkary, Rotab Mozafati, Ruthana, Safawi, and Sagai) captured with controlled computer vision systems. The images have been preprocessed with standard resizing, e.g., 224 × 224 for CNNs, and augmented with random flips and rotations during the training phase. The HT attack has been tested on the color image features with moderate complexity. The UCI Heart Disease dataset is a tabular binary classification obtained from the UCI ML Repository. It is based on the original Cleveland database and consists of 303 instances with 13 features, including age, sex, cholesterol, chest pain type, etc. It can be used to predict the presence and the absence of the heart disease. The dataset contains both the numerical and categorical features, which are normalized to the [0, 1] range, and it has been selected due to its low dimensionality and high real-world impact in medical diagnostics, where even small accuracy drops can lead to serious consequences. Fashion MNIST is a standard multiclass gray-scale image classification dataset released by Zalando Research. It includes 60,000 training and 10,000 test 28 × 28 gray-scale images, each with a resolution of 28 × 28 pixels, to cover 10 clothing classes: the T-shirt/top, Trouser, Pullover, Dress, Coat, Sandal, Shirt, Sneaker, Bag, Ankle boot. No heavy preprocessing has been applied beyond normalization to the [0, 1] range, and it has been used to evaluate the attack performance on the distributed lower-resolution image representations. The fashion CNN variant is built on the Fashion MNIST dataset using a convolutional architecture, e.g., Conv2D layers + pooling + dense layers, to represent the modern accelerator-targeted CNNs. Finally, the Histopathologic Cancer Detection, which is a binary medical image classification dataset obtained from the Kaggle competition, consists of about 220,000 labeled histopathology image patches extracted from the larger whole-slide images, used to classify the metastatic cancer presence or absence in the small tissue patches and regions. Preprocessing with resizing and augmentation has been applied to this dataset, and we have chosen it due to its high-stakes medical domain and its large-scale, high-resolution image data that allows us to test the scalability of the proposed attack. We also use different models for the evaluation purposes, as follows: multilayer perceptron (MLP) and CNN variants, trained to obtain the baseline accuracies leveraging the standard optimizers, e.g., the Adam optimizer, and loss functions, e.g., cross-entropy. The accuracy has been calculated as
, while the absolute accuracy drop is computed as
.
4.2. Results
Table 3 shows the results for the zeroing attack, where the selected weights have been reset to zero, in which the hardware reset via D flip-flops (DFFs) is simulated. The average reported absolute accuracy drop is 26.7%, which has been calculated as the mean of individual drops: 26.1%, 33.0%, 5.7%, 36.7%, 32.1%. This demonstrates that the SBWS algorithm is very efficient in identifying the most affected weights, with only a few attacks needed, even for complex datasets, including the Heart Disease, where the results show that only changing four neurons drops the accuracy by 33%. It is worth noting that the variation in the number of attacked neurons on different datasets is the direct result of the adaptive nature of the SBWS algorithm, which iteratively refines groups of weights until the reduction threshold,
, is met utilizing the smallest possible set. The high-dimensional image datasets with the distributed feature representations, e.g., Fashion MNIST grayscale images or date fruit color images, require more targeted weights (up to 12 for the MLP variant) in order to accumulate sufficient error propagation to cross
. However, the low-dimensional tabular data, such as the Heart Disease, or the highly structured medical patches (Histopathologic Cancer), allow the concentrated impact on fewer highly sensitive early-layer weights. This adaptivity ensures the maximal possible impact per modification while preserving stealth. The presented results highlight the vulnerability of the DNN accelerator in practical applications, such as medical diagnostics, in which even very small modifications can lead to substantial misclassifications and potentially endanger patient outcomes or the reliability of the system. This in turn underscores the real need for the adaptive attack techniques that account for the data dimensionality.
We also report the impact of the sign-flip attack, as shown in
Table 4, where inverting the weights (w → −w) is achieved via flipping the most significant bit (MSB). The average absolute drop is 48.1%, where the individual drops are: 37.1%, 42.0%, 31.7%, 79.9%, 49.6%. Based on the obtained results, it has been pointed out that sign-flipping achieves higher impact than the zeroing attack because it preserves the weight magnitude while reversing contributions, which mathematically disrupts the decision boundaries more severely, e.g., inverting the gradients in the backpropagation paths. For instance, in the Fashion CNN, flipping only two weights causes a catastrophic 79.9% drop in the accuracy, and this highlights the SBWS’s ability to target the most critical and important neurons in the convolutional layers. The overall average drop on both attacks is 37.4%, underscoring the effectiveness of the proposed attack. Also, the difference between zeroing and sign-flipping underscores the importance of keeping the magnitude in the attacks. The zeroing completely eliminates the contributions, which, at the same time, allows the network redundancy to partially compensate for the loss. Whereas the sign-flipping keeps the magnitude, but reverses the direction, which exploits the learned model optimizations and causes high values in the downstream layers. Such results indicate broader implications for the hardware security in the smart systems, such as the autonomous vehicles and defense applications, where the sign-flipping attack can induce stealthy failures without being detected. These emphasize the real need for strong defensive techniques.
In order to directly assess the performance under a fixed number of attacked neurons, we have evaluated the performance by attacking exactly the top-five most affected and sensitive weights, selected by SBWS under the zeroing attack. The results are as shown in
Table 5, where the average dropped accuracy is 24.7% (individually: 21.8%, 34.2%, 4.1%, 31.5%, 32.1%). This ensures that the proposed algorithm is still substantially higher than the random selection ( 9.3% avg) and assures the SBWS’s superiority even without adaptation. Note that this smaller reduction than adaptive (26.7%) is expected since some datasets benefit from 1–2 extra weights in order to fully exploit cascading effects. However, fixing the weights at 5 maintains ultra-low overhead and still delivers a strong real-world impact on the safety-critical applications.
Furthermore, we have implemented and applied the Sensitivity-Based Weight Selection (SBWS) algorithm with different hyperparameters, as follows: initial group size
(to balance between the granularity and the computation), minimum group size
(for the single-weight precision), and the reduction threshold
(optimized via leveraging the grid search on the validation subset in order to obtain highly impact with the smaller possible runtime). A 20% validation split from each dataset has been used to compute the accuracy during the SBWS algorithm and the post-attack evaluations, and this, in turn, ensures that the results will be unbiased during the assessment. We also evaluate the robustness of the SBWS algorithm by conducting the ablation studies on different
values (0.1%, 0.5%, 1.0%) across 5 different runs for each value. The lower
(0.1%) identifies 15% more weights, but the runtime is doubled (average is 2.1×), and this happens due to broader candidate retention. A higher
(1.0%) reduces the targets by 20%, but unfortunately, it lowers the average degradation by 5–7% since fewer sensitive weights have been captured. The 0.5% threshold optimizes and balances the trade-off as confirmed by the Pareto analysis of impact versus computational cost. Note that all these results are averaged over 5 runs per dataset, with a standard deviation less than 2%. We also provide a comparison between the impact of setting the sensitive weights to zero and flipping the sign of the weight value.
Table 6 shows this comparison in detail and reveals that the sign-flipping outperforms zero attacking by exploiting the learned optimizations.
The trade-off between average accuracy drop and runtime across varying degradation thresholds
is calculated and taken into consideration.
Figure 4 illustrates the Pareto front for this trade-off. The data points correspond directly to the ablation results:
achieves a high 40.2% drop but at the cost of 120 s runtime;
achieves a strong 37.4% drop with a more efficient 65 s; and
reduces the drop to 32.1% but runs quickest at 45 s. The curve confirms
and
as the optimal balance, increasing impact with smaller computational overhead, as determined via multi-objective optimization. We extend the implementation to initial group size (
: 50, 100, 200), finding
optimal (37.4% drop, 65 s runtime). Smaller groups increase precision but runtime (1.5× for 50), while larger groups reduce impact (32% for 200).
Table 7 summarizes this Pareto front, confirming
,
as the sweet spot via multi-objective optimization. We further implement the SBWS algorithm at different thresholds
and compare it with the exhaustive per-weight search technique. As explained in
Table 8, the SBWS with
accomplishes
an average accuracy drop, which is close to the
obtained by exhaustive search, while reducing the runtime by about 12× faster. As a result, elevating
will further decrease the runtime, but will also decrease the attack effectiveness. This hyperparameter analysis reveals the real practical trade-offs that the attackers encounter in the limited resource environments, such as the embedded systems, where the lower runtime (higher
) is preferred by the attackers on a very high performance reduction. The low standard deviation (<2%) on different runs indicates that the SBWS is robust and reliable on different DNN architectures. Such reliability also points to the need for defenses against such strong attacks. Moreover, in order to assess the effectiveness of the SBWS algorithm, we directly compare it with the random weight selection utilizing the same number of modified weights. As shown in
Table 9, attacking the selected weights by the SBWS algorithm will cause significantly higher accuracy degradation than the random selection on all models. In fact, this demonstrates that the sensitivity-guided selection is very critical to achieving a higher possible impact with a smaller possible number of modifications.
In fact, the proposed SBWS enables higher impact on the performance of the model with only a few modifications compared to random weight attacks, where the baseline average drops 12% based on the tests with very small Trojan overhead. It is worthy to mention that the design has been synthesized using the Synopsys Design Compiler on TSMC 45 nm library, and results show that the HT incurs very low area overhead (0.4%) and power dissipation (0.3%), which is much better than the ones in the related literature on the DNN HTs, which are typically
for stealth attacks. To further validate this work, we use the statistical analysis via the paired
t-tests, 10 runs per model,
n = 50 samples, and the
p-value
, and the results confirm a significant reduction in the accuracy. Compared to prior works that included the recent resilient designs [
45] and the general noise injection, with 20–30% drops [
48], the proposed Trojan is much stealthier due to careful selection of rare triggers and the implemented SBWS-targeted selection, which also evades Siamese NN detection [
46] by minimizing side-channel signatures. Note that the low overhead further improves the stealthiness since the SBWS can be integrated into the limited-resource IoT devices without triggering the design verification alarms. The statistical validation (
) shows that the observed performance reduction is not random, and this implies that the proposed SBWS can be extended to bypass strong defenses, e.g., the runtime monitoring, if it has been combined with the polymorphic triggers.
Even though the proposed attack is significant and powerful, it is important to mention its limitations, where the white-box assumption is used. This may not hold in the fully obfuscated systems, and also gives a lack of evaluation on certain transformers, such as BERT. Furthermore, fixed-point quantization may mitigate the impact by reducing bit-flip sensitivity, and large-scale models, e.g., GPT-like models, may require scaled SBWS to be feasible. Ethically, this research highlights vulnerabilities to inform defenses, not enable attacks; all experiments were simulated without real hardware deployment to avoid harm. In addition to these limitations, this technique requires white-box access, which makes it less applicable in black-box attack settings in which the attackers do not have knowledge about the model architecture. One can carefully address this issue by augmenting the approximation methods, such as the query-based the sensitivity estimation. Also, the impact of this work has not been evaluated on the transformer models since the attention techniques have different sensitivity patterns.