5.1. Predictive Performance Comparison
This section presents a systematic evaluation of the predictive performance of the proposed SSC-PINN framework relative to various baseline models. This comparison confirms the effectiveness of the framework in estimating the shear strength of seasonally frozen silty clay. The comparative baseline suite encompasses traditional machine learning algorithms as well as deep neural network architectures. Standard evaluation metrics, specifically the Coefficient of Determination (
), Root Mean Squared Error (RMSE), and Mean Absolute Error (MAE), provide quantitative measures of model performance.
Table 2 summarizes the statistical outcomes and performance comparisons, while
Figure 9 illustrates these evaluation results.
The performance comparison indicates that the proposed SSC-PINN framework outperforms all baseline models across all primary evaluation metrics. Specifically, the framework achieves the highest coefficient of determination () on the test set. The model also yields the lowest RMSE (1.329) and MAE (1.088), demonstrating high predictive accuracy and generalization capacity. The standard PINN, which incorporates physics-informed constraints without the contrastive learning stage, exhibits competitive performance with an of 0.974; nonetheless, both its RMSE and MAE values are higher than those of the SSC-PINN. The FSNN provides acceptable forecasts with an of 0.978, yet it is outperformed by the SSC-PINN due to the latter’s lower error metrics. Conventional machine learning techniques exhibit lower accuracy; specifically, RF and SVR yield values of 0.975 and 0.601, respectively, while the LR model produces significant prediction errors with an of 0.778. These findings demonstrate the efficacy of integrating self-supervised contrastive learning with a physics-informed loss formulation. This combination significantly enhances geomechanical modeling performance, offering distinct advantages for characterizing the shear strength of seasonally frozen silty clay.
Figure 10 illustrates the convergence path of the objective function for the SSC-PINN model. The curve exhibits an optimization pattern characteristic of deep neural network architectures. This behavior features a sharp decrease in the total loss during the initial training epochs, followed by an asymptotic stabilization phase. Within this phase, minor statistical fluctuations are observed. At the onset of optimization, the network rapidly adjusts its parameter space to capture the primary features and multidimensional correlations inherent in the dataset. This rapid adjustment demonstrates its capability to efficiently reduce empirical error.
In the later stages of training, the loss curve stabilizes, indicating that the model has approached an optimal state within the solution space. Marginal oscillations occur during this period, reflecting localized adjustments in network weights. These adjustments yield incremental refinements to the predictive response surface. The convergence of the objective function to a well-defined minimum validates the efficacy of the optimization framework. The process effectively minimizes both the empirical data-driven loss and the physics-informed residual components. Consequently, the network achieves high predictive accuracy while strictly satisfying the prescribed boundary conditions and constitutive laws. This training behavior confirms the robustness of the structural configuration of the SSC-PINN framework. The optimization pathway ensures that the learned latent representations correlate strongly with the underlying physical laws governing seasonally frozen soil mechanics.
Figure 11 illustrates the scatter plots, residual distributions, and error profiles of the six comparative models. The performance comparison indicates that the SSC-PINN framework exhibits the highest predictive accuracy. Specifically, the model achieves a test coefficient of determination (
) of 0.988. The optimization also yields the lowest RMSE and MAE values of 1.329 and 1.088, respectively. The SSC-PINN framework demonstrates superior generalization capability compared to the standard PINN and FSNN architectures, which is achieved by effectively coupling self-supervised contrastive representation learning with domain-specific physical constraints. Conversely, conventional data-driven methods—specifically Random Forest (RF), Support Vector Regression (SVR), and Linear Regression (LR)—are significantly less precise. Their lower accuracy highlights the inherent limitations of these methods in capturing the nonlinear geomechanical behavior of the soil matrix. These findings validate the efficacy of the unified SSC-PINN framework, demonstrating that the integration of self-supervised representation learning with physics-informed loss formulations substantially enhances both model robustness and predictive reliability.
5.2. Ablation Study
An ablation study is conducted to evaluate the relative contributions of the primary architectural components within the proposed SSC-PINN framework. This analysis assesses the specific functions of key components, namely self-supervised contrastive learning and physics-informed loss regularization, measuring their direct effects on overall predictive accuracy and generalization performance.
Table 3 summarizes the statistical metrics for each ablation configuration, including the Coefficient of Determination
, Root Mean Squared Error (RMSE), and Mean Absolute Error (MAE), with comparisons illustrated in
Figure 12.
The ablation analysis demonstrates the critical roles of both self-supervised contrastive learning and physics-informed loss regularization in defining the complete SSC-PINN framework. The full SSC-PINN model, which integrates both components, achieves superior performance across all evaluation metrics. Specifically, it yields a test of 0.988, an RMSE of 1.329, and an MAE of 1.088. These quantitative results indicate that coupling contrastive learning with physics-informed loss functions provides highly accurate and robust predictions of soil shear strength, where the contrastive module enhances latent representations while the physics-informed loss enforces physical consistency.
Eliminating either architectural element results in a significant deterioration in predictive accuracy. The standard PINN structure, which incorporates the physics-informed loss but lacks contrastive learning, achieves a test coefficient of determination of 0.974 and a test RMSE of 1.275. This indicates that while physics-informed regularization provides critical optimization guidance, this variant underperforms compared to the full SSC-PINN architecture. Conversely, the ablation variant utilizing only self-supervised contrastive learning displays a substantial reduction in accuracy due to the omission of physics-informed loss terms. This variant yields a test of 0.860, an RMSE of 2.350, and an MAE of 2.200. This performance degradation highlights the consequences of neglecting physical constraints; although contrastive learning enhances latent feature extraction, omitting physical laws compromises generalization capability, causing predictions to deviate from the actual mechanical behavior of frozen soils.
The FSNN baseline, which lacks both self-supervised pretraining and physics-informed regularization, provides a test of 0.978. Nevertheless, the unified SSC-PINN framework ultimately outperforms this baseline. These comparative results demonstrate the efficacy of the proposed architectural modifications. Systematically introducing either data-driven representation learning or domain-specific physical constraints enhances both the predictive performance and generalization capability of the network. In conclusion, the ablation experiment highlights the paramount role of integrating data-driven representation learning with physical domain knowledge in geomechanical predictive modeling. The assessment demonstrates that the proposed SSC-PINN framework serves as an effective methodology for predicting the shear strength of seasonally frozen silty clay, yielding significant advancements over conventional machine learning algorithms and purely supervised neural networks.
Furthermore, to provide a comprehensive context regarding other research methodologies, these internal ablation outcomes are explicitly cross referenced with the comparative analysis detailed in
Section 5.1. As demonstrated in that section, the unified SSC PINN framework not only surpasses its own architectural variants but also significantly outperforms established models such as Random Forest and Support Vector Regression, which are frequently utilized in contemporary geotechnical research. Therefore, it is firmly demonstrated by this integrated assessment that the proposed framework yields significant advancements over both purely supervised neural networks and conventional machine learning algorithms.
5.3. Sensitivity Analysis of Key Hyperparameters
This section presents a systematic sensitivity analysis to evaluate the effects of core hyperparameters on the predictive performance and optimization stability of the SSC-PINN model. Hyperparameter calibration ensures optimal convergence and enhances generalization capacity to unseen data. By varying these parameters within designated intervals, the distinct contributions of each hyperparameter to predictive accuracy and structural stability can be quantitatively determined.
The sensitivity evaluation targets key architectural and optimization hyperparameters. First, the learning rate
regulates the step size during gradient backpropagation; an excessively high learning rate can cause the optimization pathway to oscillate or overshoot the optimal solution, whereas an overly low rate leads to slow convergence or entrapment in local minima [
42]. The evaluated range for the learning rate is
. Second, the number of hidden layers defines the network depth, which determines the structural capacity of the model. The capability of the network to map complex nonlinear geomechanical relationships is significantly enhanced by increasing the hidden layer count. However, the risk of overfitting is inevitably increased by an excessively deep architecture, especially when small sample sizes are utilized [
53]. This hyperparameter is tested within the range of
. Third, the network width is controlled by the number of neurons per hidden layer, and the representation capacity of the model is thereby dictated. Intricate soil behavior patterns can be successfully captured when the network width is expanded. However, severe overparameterization can be induced by excessively large configurations, and overfitting is consequently caused, as documented in established deep learning literature [
53]. The prescribed evaluation range is
.
The remaining parameters govern the optimization dynamics and regularization constraints of the framework. Fourth, the batch size defines the number of training samples processed per forward and backward pass. Stochastic gradient noise is introduced by smaller batch sizes, and the model is theoretically assisted in escaping saddle points by this noise, although convergence may be destabilized. Conversely, consistent gradient estimates are yielded by larger batch sizes at higher computational costs, as extensively documented in neural network optimization literature [
54]. The selected evaluation range is
. Fifth, weight decay is implemented as an
regularization penalty to mitigate overfitting by penalizing excessive parameter magnitudes. While model complexity is effectively restricted by stronger regularization, network expressiveness is severely dampened by overly high penalties, and the effective representation of underlying physical laws is thereby prevented, as established in fundamental machine learning literature [
55]. The evaluated range is
. Sixth, the sharpness of the similarity distribution between positive and negative sample pairs within the contrastive objective function is regulated by the contrastive temperature parameter. A smoother probability distribution is yielded by a higher temperature, whereas the distribution is sharpened by a lower temperature, thereby forcing the optimization to focus on hard negative pairs, as extensively detailed in contrastive learning literature [
56]. The selected evaluation range is
.
To execute the sensitivity analysis, the SSC-PINN model is trained independently for 10,000 epochs under each specific hyperparameter configuration to ensure thorough optimization. Subsequently, the predictive performance on the test set is quantitatively evaluated using the previously defined statistical metrics. Specifically, the Coefficient of Determination (), Root Mean Squared Error (RMSE), and Mean Absolute Error (MAE) are computed to assess the accuracy, stability, and generalization capability of each model variant under identical validation conditions.
Table 4 presents a summary of the sensitivity analysis for the learning rate parameter (
), with the corresponding results illustrated in
Figure 13. The evaluation indicates that the optimal learning rate is
, under which the model achieves a peak coefficient of determination (
) of 0.988 and minimizes both RMSE and MAE values. Conversely, a smaller learning rate (
) results in insufficient optimization dynamics, leading to inadequate convergence within the prescribed training cycles. Excessively high learning rates (
) induce numerical instability, causing severe gradient oscillations and a drastic deterioration in predictive accuracy.
Table 5 summarizes the sensitivity analysis regarding the number of hidden layers, which defines the network depth, with the evaluation findings illustrated in
Figure 14. The experimental results demonstrate that a three-layer configuration yields the optimal performance, achieving the maximum coefficient of determination (
) while minimizing the RMSE and MAE values. Increasing the network depth beyond this optimal point results in diminishing returns or induces overfitting, as excessive parameter complexity weakens the generalization capacity of the model on the unseen test split.
Table 6 presents the sensitivity analysis for the number of neurons per hidden layer, representing the network width, with the evaluation results depicted in
Figure 15. The experimental findings indicate that optimal predictive performance is achieved with a configuration of 64 neurons per hidden layer. This setup establishes an effective balance between representational capacity and over-parameterization mitigation. A low neuron density (32 neurons) constrains the expressive capability of the network, restricting its ability to capture complex, multidimensional geomechanical interactions. Conversely, expanding the hidden layer width to 256 neurons yields diminishing returns; under this configuration, computational complexity increases and the risk of over-parameterization rises without producing a significant improvement in predictive accuracy.
This scaling-down analysis specifically verifies that the optimization trajectory does not get trapped in local minima and that the network does not overfit the 100 empirical data points. By constraining the architecture to 3 layers with 64 neurons, the degrees of freedom are appropriately balanced against the dataset size. Furthermore, it should be noted that the effective training size is significantly expanded beyond the 100 base samples. The self-supervised contrastive learning stage generates thousands of augmented views, and the physics-informed loss utilizes continuous collocation points across the temporal domain, providing massive structural regularization to guide the model toward the global optimum.
Table 7 lists the sensitivity analysis for the batch size configuration, with the evaluation results shown in
Figure 16. The experimental findings indicate that a small batch size of 16 yields the highest predictive performance. This enhanced efficacy is primarily attributed to the increased frequency of parameter updates per epoch. This update rate introduces beneficial stochastic noise into the gradient descent pathway, thereby accelerating network convergence and facilitating escape from local minima. Conversely, increasing the batch size provides more consistent and deterministic gradient estimates; however, this expansion causes a slight deterioration in predictive accuracy. Optimization literature frequently attributes this behavior to the optimization trajectory settling into less adaptable regions of the solution space.
Table 8 presents the sensitivity analysis for the batch size configuration, with the evaluation findings depicted in
Figure 17. Experimental findings show that a compact batch size of 16 delivers optimal predictive performance. This improved efficacy is mainly due to the accelerated rate of parameter updates per epoch. This operational rate introduces beneficial stochastic noise into the gradient descent trajectory. Subsequently, this noise accelerates network convergence and enables the model to escape local minima. Conversely, increasing the batch size offers more stable and deterministic gradient estimates. However, this expansion results in a negligible decrease in predictive accuracy, a behavior commonly attributed in optimization literature to the trajectory entering less adaptable regions of the solution space.
Table 9 summarizes the sensitivity analysis for the contrastive temperature parameter (
), and the results of the evaluation are shown in
Figure 18. The experiment shows that the best predictive performance is achieved at a temperature coefficient of 0.2. This means that the optimal parameter gives a moderate scaling of the sharpness of the distribution of similarity in the contrastive learning objective function. Such a modulation improves the generalization ability of the model. Also, this setting balances the penalty allocation of positive and negative example pairs in such a way as to prevent the contrastive loss from becoming too diffused which would hide important latent qualities but without putting too much emphasis on a small group of difficult negative pairs that would lead to optimization instability.