Next Article in Journal
Synthesis and Characterization of Calcium Hydroxyapatite from Waste Phosphogypsum
Previous Article in Journal
Smart Corrosion Monitoring in AA2055 Using Hidden Markov Models and Electrochemical Noise Signal Processing
Previous Article in Special Issue
Static Behavior of Post-Installed High-Strength Large-Bolt Shear Connector with Fabricated Hybrid Fiber-Reinforced Concrete/Ordinary Concrete Deck
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Application of XGBoost Model Optimized by Multi-Algorithm Ensemble in Predicting FRP-Concrete Interfacial Bond Strength

School of Resources and Safety Engineering, Central South University, Changsha 410083, China
*
Author to whom correspondence should be addressed.
Materials 2025, 18(12), 2868; https://doi.org/10.3390/ma18122868
Submission received: 27 March 2025 / Revised: 19 May 2025 / Accepted: 14 June 2025 / Published: 17 June 2025

Abstract

:
Accurate prediction of fiber-reinforced polymer (FRP)-concrete interfacial bond strength is critical for ensuring the safety of FRP-strengthened structures. This study proposes a predictive model based on extreme gradient boosting (XGBoost), which is enhanced via the Nevergrad optimization framework, to address the limited accuracy of traditional empirical approaches. By integrating seven optimizers from the Nevergrad platform, the model achieves global hyperparameter optimization, and a five-fold cross-validation strategy is employed to improve generalization. The prediction results based on 855 sets of single-lap shear test data demonstrate that the optimized model exhibits significantly superior performance on the test set (R2 = 0.9726, RMSE = 1.8745, MAE = 1.3857). Compared to the existing best-performing empirical model, the R2 is improved by 22.3%, while the RMSE and MAE are reduced by 63.4% and 61.8%, respectively. SHAP interpretability analysis indicates that the width, thickness, elastic modulus, and bond length of the FRP sheets are the main factors influencing the bond strength prediction. The predictive model developed in this study combines high accuracy with strong interpretability, providing a reliable, intelligent tool for designing FRP-strengthened structures.

1. Introduction

Fiber-reinforced polymers (FRP), which are composed of high-strength fibers and a polymer matrix, possess characteristics such as high strength, low weight, and excellent corrosion resistance [1]. As an advanced high-performance composite material, FRP has been widely adopted in civil engineering, particularly for strengthening and repairing reinforced-concrete structures [2,3]. In engineering practice, FRP is typically externally bonded to the surface of concrete, forming an FRP-concrete interface that serves as a critical zone for load transfer. The bond strength at this interface directly affects the composite action of the FRP strengthening system and its overall structural reliability. Therefore, accurately predicting the bond strength at the FRP-concrete interface is essential for engineering design and safety evaluation.
The academic community has systematically investigated the bonding mechanism of the FRP-concrete interface and proposed various bond strength prediction models (Table 1) [3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21]. Specifically, the proposed approaches fall into three categories: empirical models derived from experimental data, semi-empirical models incorporating fracture mechanics theory, and models based on interfacial bond slip relationships. Early studies relied on single lap shear test data to derive empirical formulations [4,6,8,10]. These formulations typically use average bond shear stress methods to estimate interfacial performance. However, these models often fail to adequately account for critical parameters, such as the effective FRP bond length, material heterogeneity, and localized interfacial effects, resulting in significant deviations when applied to real-world engineering predictions. Subsequent advances in fracture mechanics have enabled the development of semi-empirical bond-strength models [3,5,11,17,18,19], in which parameters such as the effective bond length and stress-field distribution functions have been systematically incorporated. These models can capture the nonlinear bond behavior under load more accurately, thereby providing a more robust theoretical basis for the structural strengthening design. Although these models yield reasonable predictions under certain conditions, their development based on specific experimental datasets limits their applicability and fails to fully account for the complex nonlinear mechanical characteristics of the FRP-concrete interface [22,23,24,25].
In recent years, fueled by the growth of big data and advances in machine learning, new approaches have been developed to address complex nonlinear problems. Recent studies have established diverse predictive models for the FRP–concrete interfacial bond strength using extensive experimental datasets [23,24,25,26,27,28,29,30]. For instance, Zhou et al. [23] employed a backpropagation neural network (BPNN) to develop an explicit prediction model that outperforms most traditional models in terms of accuracy. Su et al. [26] compared three machine learning methods and found that the support vector machine (SVM) exhibited the best performance, with prediction accuracy further enhanced by a stacking ensemble. Zhang et al. [25] systematically evaluated six machine learning models based on a single-lap shear test database, and the results showed that the extreme gradient boosting (XGBoost) achieved a 54% reduction in coefficient of variation compared to optimal traditional models. These studies demonstrate that machine learning methods can substantially improve the accuracy of FRP-concrete interfacial bond strength predictions. However, the generalization ability and stability of these models still require improvement, and the selection of model hyperparameters significantly impacts the final prediction accuracy. Consequently, developing effective hyperparameter optimization frameworks to simultaneously improve prediction precision and enhance model interpretability remains a key research challenge.
This study proposes a Nevergrad-optimized XGBoost framework (Nevergrad-XGBoost) to improve the prediction accuracy and robustness of the FRP-concrete interfacial bond strength. By integrating seven built-in optimizers from Nevergrad for hyperparameter tuning of the XGBoost model, in conjunction with a 5-fold cross-validation mechanism, intelligent optimization of the model’s hyperparameters is achieved to construct the optimal predictive model. Furthermore, to improve model interpretability, the Shapley Additive exPlanations (SHAP) method was employed to quantitatively assess the contributions of different input features, thereby revealing the mechanisms influencing the bond strength at the FRP–concrete interface.

2. Database

2.1. Data Sources

The data used in this study are derived from a large-scale database established by Zhou et al. [23], which includes 969 sets of FRP–concrete interface single-lap shear test results collected from 34 existing studies. The single-lap shear test is regarded as one of the most effective methods for investigating the bond performance between FRP and concrete interfaces [31]. These tests primarily focus on measuring the ultimate bond strength and encompass the key material properties and geometric parameters. To eliminate the influence of specimen size variations across different studies, the compressive and tensile strengths of the concrete are converted. Specifically, the tensile strength ft is converted using the formula ft = 0.395(fc)0.55, as specified in the Chinese concrete code GB 50010-2010 [32]. In addition, the concrete cube compressive strength fc is converted to the equivalent cylinder compressive strength fc′ using the relevant conversion coefficients, as detailed in Reference [23].
To enhance the data quality, the original dataset was filtered based on a unified criterion. Specifically, in a set of data with the same test parameters, if the target value Pu of a certain data point differs from the others by more than 15%, while the differences among the remaining data points are within 15%, this data point is identified as an outlier and excluded; under the same test parameter group, if the difference between any two data points in the group exceeds 15%, the whole set of data is removed. After processing, 855 sets of high-quality experimental data were ultimately retained. The database includes the following parameters:
  • The material properties: the compressive strength of a concrete cylinder (fc′) and the elastic modulus of the FRP sheets (Ef);
  • The geometrical parameters: the thickness (tf), width (bf), and bond length (Lf) of the FRP sheets and the concrete substrate width (bc);
  • The bond strength of the FRP-concrete interface (Pu).

2.2. Data Description

To develop the predictive model, this study selects material properties (fc′ and Ef) and geometric parameters (tf, bf, Lf, and bc) as input features, and Pu serves as the target variable. The statistical characteristics of these parameters, including the minimum, maximum, mean, and quartiles (Q1, Q3, etc.), are summarized in Table 2. The dataset is randomly divided into 80% for training and 20% for testing. Figure 1 illustrates the sample distributions in the training and test sets, as well as the correlation analysis of the input features. The results indicate that the training and test sets exhibit a similar distribution in the feature space, and no significant multicollinearity is detected among the input features.

3. Methods

3.1. Nevergrad Optimization Library

Nevergrad is an open-source, gradient-free optimization library developed by Facebook [33,34]. It efficiently addresses optimization problems in continuous, discrete, or mixed parameter spaces and is well-suited for hyperparameter tuning in machine learning. The library supports multiple optimization algorithms. Seven of these algorithms were selected in this study to tune the hyperparameters of the XGBoost regression model.
  • Covariance matrix adaptation evolution strategy (CMA): The CMA is an evolutionary optimization algorithm based on a multivariate Gaussian distribution [35]. It dynamically updates the mean vector, covariance matrix, and step size parameter to match the geometric characteristics of the objective function. In each iteration, candidate solutions are sampled, and their fitness is evaluated, with the mean updated via weighted recombination. The covariance matrix is refined using both the Rank-μ strategy (current generation information) and the Rank-1 strategy (historical path). An independent evolution path controls the step size scaling, thereby achieving efficient optimization of both the search direction and scale.
  • Two-point differential evolution (TwoPointsDE): TwoPointsDE is a variant of differential evolution whose core innovation lies in replacing the classical binomial crossover with a two-point crossover mechanism [36]. The algorithm randomly selects two crossover points and replaces the parameter segment within the selected interval of the mutation-generated donor vector with the target individual. This design preserves the dependencies between adjacent parameters and reduces the disruption to potentially beneficial schemata, thus enhancing the global exploration capability of the algorithm.
  • Particle swarm optimization (PSO): PSO is a swarm intelligence optimization algorithm that simulates the collective behavior of bird flocks and fish schools [37]. The algorithm is optimized by simulating particles moving through the search space. Each particle represents a potential solution and retains records of its personal best position and the global best position. The PSO dynamically adjusts each particle’s velocity and position based on individual memory and social collaboration, enabling the swarm to progressively converge toward the optimal solution.
  • Random Search: Random Search identifies the optimal solution by performing uniform random sampling of candidate solutions within a predefined search space and evaluating their corresponding objective function values [38].
  • ScrHammersley: ScrHammersley is an optimization algorithm based on low-discrepancy sequences, specifically the Hammersley sequence, combined with scrambling techniques in a quasi-Monte Carlo framework [39,40]. It employs deterministic sampling points to achieve efficient and uniform exploration of parameter space. Compared with a pure random search, ScrHammersley mitigates sample clustering and uneven coverage issues, thereby enhancing the quality of the initial population.
  • DiscreteOnePlusOne: This algorithm is a (1 + 1) evolution strategy variant tailored for discrete optimization within the Nevergrad framework [33,34,41]. It operates through a single-individual iterative optimization mechanism, where each iteration maintains a parent solution and generates an offspring via probabilistic perturbation operators (e.g., discrete parameter flipping or categorical resets). A greedy selection mechanism determines whether the parent solution should be replaced. The algorithm implements an adaptive mutation strategy that dynamically adjusts the perturbation probabilities to maintain the exploration-exploitation balance.
  • NGOpt: NGOpt is a general-purpose optimizer in the Nevergrad library based on dynamic multi-strategy collaboration [33,42]. It is designed to automatically adapt to problem characteristics and select the most suitable optimization strategies.

3.2. XGBoost

Extreme gradient boosting (XGBoost), proposed by Chen et al. [43], is an ensemble method based on gradient-boosting decision trees and is widely applied across various domains. The core idea of XGBoost is to integrate multiple weak learners, typically decision trees, using the gradient boosting algorithm [44,45]. In each iteration, XGBoost adds a new tree to fit the residuals (i.e., the differences between the actual and predicted values) of the previous model. The algorithm then updates the model parameters by minimizing the regularized objective function. The objective function of XGBoost is presented in Equation (1).
L f = i l y ^ i , y i + k Ω f k w h e r e Ω f = ϒ T + 1 2 λ ω 2
where, l y ^ i , y i represents the loss function, where y ^ i is the predicted value, and y i is the actual value. Ω f k denotes the regularization term, which is used to control the model complexity. f k represents the model of the k-th tree, T is the number of leaf nodes in the k-th tree and ω is the weight of the leaf nodes in the k-th tree. Additionally, ϒ represents the penalty regularization term for the leaf nodes, while λ is the penalty regularization term for the leaf weights.

3.3. Evaluation Metrics

To quantify the predictive performance of the model, this study employs the mean squared error (MSE), root mean squared error (RMSE), and coefficient of determination (R2) as evaluation metrics [46,47,48,49,50,51,52,53]. The formulas for these metrics are as follows:
R 2 = 1 P i P ^ i 2 P i P ¯ i 2
RMSE = 1 N i = 1 N P i P ^ i 2
MAE = 1 N i = 1 N | P i P ^ i |
where N represents the number of samples, P i denotes the actual values, P ^ i represents the predicted values, and P ¯ i is the mean of the actual values.

3.4. Model Construction

Figure 2 illustrates the framework for constructing the XGBoost bond strength prediction model based on multi-algorithm ensemble optimization. The dataset is randomly split into a training set (80%) and an independent test set (20%). The Nevergrad framework integrates seven optimization algorithms to search for optimal hyperparameters within a predefined search space, including n_estimators, learning_rate, and max_depth. The model uses the five-fold cross-validated average root-mean-square error (CV_Avg_RMSE) as its optimization objective, thereby ensuring robust hyperparameter selection. During optimization, the system records the convergence trajectories and evaluation metrics (R2, RMSE, and MAE) of each algorithm. A multi-dimensional algorithmic performance assessment is conducted based on the predictive accuracy of the validation subsets, ultimately selecting the optimal hyperparameter combination. The optimized parameters are then applied to XGBoost to construct a high-performance regression model, which is subsequently validated on an independent test set. A systematic comparison with existing bond strength models is conducted to ensure the superior performance of the constructed model. To further analyze the decision-making mechanism of the model, SHAP analysis is employed to quantitatively characterize the contribution of each input variable to the prediction outcomes.

4. Results

4.1. Hyperparameter Optimization

The predefined hyperparameter search space is presented in Table 3. Figure 3a presents the variation trend of the objective function value CV_Avg_RMSE with respect to the number of iterations (budget) during the optimization process. Figure 3b shows the best objective values obtained by the seven optimizers, along with their corresponding computational times. Among these optimizers, TwoPointsDE achieves the lowest CV_Avg_RMSE within the 500-iteration budget while requiring the least optimization time. Figure 3c presents a bubble chart that provides an intuitive comparison of the overall performance of the different optimization methods. The horizontal axis represents the cross-validation average R2 (CV_Avg_R2), and the vertical axis corresponds to CV_Avg_RMSE. The bubble size indicates the cross-validation average MAE (CV_Avg_MAE), and different colors distinguish the optimizers used. From Figure 3c, TwoPointsDE achieves lower CV_Avg_RMSE and CV_Avg_MAE values compared to the other optimizers, while its CV_Avg_R2 is second only to PSO, indicating that it exhibits the best overall performance.
Figure 3d,e provides a detailed visualization of the optimization process of TwoPointsDE, illustrating the evolution of the objective function value and the hyperparameter optimization trajectory. Ultimately, TwoPointsDE determines the optimal set of XGBoost hyperparameters as follows: n_estimators = 90, learning_rate = 0.12737845681247, and max_depth = 8. Further details regarding the optimization results for all the optimizers are presented in Table 4.

4.2. Comparison of Prediction Performance

The optimized XGBoost model is used to predict the test dataset, and the results are illustrated in Figure 4. The red dashed line represents the ideal scenario, where the predicted values equal the actual values (y = x), and the blue solid line denotes the regression fit of the model predictions. As shown in the figure, the model achieves an R2 of 0.9726, indicating a strong predictive capability. Furthermore, the RMSE and MAE are 1.8745 and 1.3857, respectively, demonstrating low prediction errors and high accuracies. The residual distribution plot on the right reveals that most residuals are symmetrically distributed around zero, with only a few extreme deviations, suggesting no significant systematic bias in the model predictions. The color bar represents the absolute values of the prediction residuals, where darker colors indicate smaller errors and lighter colors correspond to larger deviations. Overall, the optimized XGBoost model performs well on the test dataset, effectively capturing the actual data trends with high predictive accuracy.
To further evaluate the model performance, existing strength prediction models were applied to the same test set, with their prediction results illustrated in Figure 5. The results demonstrate that among the existing models, the model proposed by Maeda et al. [8] (R2 = 0.7898, RMSE = 5.1935, MAE = 3.8411), Niedermeier [11] (R2 = 0.7955, RMSE = 5.1222, MAE = 3.6248), and Zhou [20] (R2 = 0.7660, RMSE = 5.4800, MAE = 3.8249) exhibit relatively superior predictive performance. Additionally, the ANN model trained by Zhou et al. [23] using the same database achieved prediction results of R2 = 0.928 and RMSE = 3.584 on the test set. The Nevergrad-XGBoost model developed in this study achieves an approximately 22.3% improvement in R2, a reduction of about 63.4% in RMSE, and a reduction of roughly 61.8% in MAE compared to the best-performing existing empirical model (Niedermeier [11]). Moreover, when compared with the ANN model proposed by Zhou et al. [23], the Nevergrad-XGBoost model demonstrates an approximate 4.8% increase in R2 and a reduction of about 47.7% in RMSE (see Table 5 for details). These comparisons demonstrate that the proposed model offers markedly superior predictive accuracy and generalization performance.

4.3. Interpretability Analysis

This study employs the Shapley Additive exPlanations (SHAP) interpretability analysis method, which is based on cooperative game theory [54,55], to quantitatively assess the feature contributions in the Nevergrad-XGBoost model. By computing the marginal contributions of different feature combinations to the prediction results, this study systematically evaluates the influence mechanisms of various input parameters on the prediction of the bond strength at the FRP-concrete interface. The sign of the SHAP value indicates the directional impact of a feature on the prediction: a SHAP value greater than zero signifies a positive contribution to the prediction outcome, whereas a SHAP value less than zero indicates a suppressive effect.
As shown in the SHAP summary plot in Figure 6a, bf, tf, and Ef are the three features contributing most to the model output, which is broadly consistent with the feature importance analyses reported by Zhang et al. [25] and Su et al. [26]. Further analysis of the SHAP scatter plots in Figure 6b suggests that the SHAP values of bf, tf, Ef, and Lf are generally positively correlated with their respective feature values. Specifically, the pronounced influence of bf may have arisen from the expansion of the interaction area between the FRP sheet and concrete over a larger surface. An increase in bf implies an enlarged bond interface area and a more uniform stress distribution, thereby enhancing bond strength. For relatively small tf values, the SHAP values are negative. This is due to an excessively low tf causing insufficient axial stiffness (Eftf) of the FRP, localized stress concentrations, and weakened interfacial friction, ultimately reducing the bond strength. Although Lf also exhibited a positive correlation with the SHAP values, its SHAP contributions were mostly confined within the range of [−6, 6]. This may be attributed to the fact that once Lf exceeds the effective bond length, further increasing Lf no longer significantly improves the bond strength. It is noteworthy that numerous studies have demonstrated the significant effect of bf on bond strength; however, due to differences in interpretability methods, experimental protocols, FRP material types, and adhesive layer properties, the relative importance of each feature may also vary across the literature.
Figure 7 presents the SHAP force plot, which intuitively illustrates the specific contributions of individual input features to the final prediction for a particular sample in the test set. According to Table 6, the feature values of this sample are as follows: bc = 150 mm, fc′ = 74.67 MPa, Ef = 73 GPa, tf = 0.169 mm, bf = 100 mm, and Lf = 100 mm. Based on these feature values, the model’s baseline prediction (i.e., the initial prediction value in the absence of any feature contributions) is 17.7713. For this particular sample, bf exhibits the highest positive contribution to the prediction, with a SHAP value of 4.8879. In contrast, Ef has the highest negative contribution, with a SHAP value of −4.4544. After aggregating the positive and negative contributions of all features, the final predicted value of the model for this sample is 14.5847 kN. The actual bond strength for this sample is 15.14 kN, demonstrating close agreement between the predicted and actual values. This result validates the effectiveness of the model in predicting the bond strength of the FRP-concrete interface.
SHAP analysis effectively elucidates the influence mechanisms of different features on model prediction outcomes, providing data-driven support for an in-depth understanding of the predictive mechanisms governing the FRP-concrete interfacial bond strength.

5. Conclusions

This study proposes a Nevergrad-optimized XGBoost model (Nevergrad-XGBoost) for predicting the bond strength of FRP-concrete interfaces. By integrating seven built-in Nevergrad optimization algorithms with a 5-fold cross-validation mechanism, intelligent hyperparameter search and optimization for XGBoost are achieved, resulting in a high-performance predictive model. The principal findings are summarized as follows:
  • By comparing the hyperparameter optimization results of the seven built-in Nevergrad optimizers, it was found that the TwoPointsDE algorithm achieved the lowest CV_Avg_RMSE (2.85207) within 500 iterations while requiring the shortest computational time (361.25 s), demonstrating an excellent balance between exploration and exploitation. The optimized hyperparameter combination (n_estimators = 90, learning_rate = 0.12737845681247, max_depth = 8) significantly enhanced the predictive performance of the model.
  • The Nevergrad-XGBoost model demonstrates outstanding predictive capability on the test set, with performance metrics of R2 = 0.9726, RMSE = 1.8745, and MAE = 1.3857. Compared with the best-performing empirical model, the R2 of Nevergrad-XGBoost improves by 22.3%, while the RMSE and MAE decrease by 63.4% and 61.8%, respectively. When compared with the ANN model, the R2 increases by 4.8%, and the RMSE decreases by 47.7%, confirming its significant advantages in both predictive accuracy and generalization ability.
  • The SHAP-based interpretability analysis reveals that the contribution of features to the prediction results, from highest to lowest, is as follows: bf, tf, Ef, Lf, fc′, and bc. The feature values of bf, tf, Ef, and Lf show a generally positive correlation with the SHAP values. The global and local interpretation results support the model’s interpretability requirements for engineering applications.
In summary, the XGBoost model optimized by Nevergrad can accurately predict the bond strength at the FRP–concrete interface, providing a new approach for the cost-effective optimization of FRP strengthening parameters. When combined with field monitoring data, the model can support the dynamic evaluation of the residual load-bearing capacity of structures. Moreover, the core algorithmic architecture and interpretability analysis framework employed in this study can be extended to predict the performance of other composite material–concrete interfaces.

Author Contributions

Y.C.: Methodology, Validation, Resources, Visualization, Software, Writing—original draft; Y.Z.: Visualization, Writing—review & editing; C.L.: Investigation, Writing—review & editing; J.Z.: Conceptualization, Methodology, Validation, Investigation, Visualization, Writing—review & editing, Supervision, Funding acquisition. All authors have read and agreed to the published version of the manuscript.

Funding

This research is partially supported by the Outstanding Youth Project of the Hunan Provincial Department of Education (23B0008), and the Zhumadian Key R&D Special Project (ZMDSZDZX2023006).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Bank, L.C. Composites for Construction: Structural Design with FRP Materials; John Wiley & Sons: Hoboken, NJ, USA, 2006. [Google Scholar]
  2. Teng, J.G.; Chen, J.F.; Smith, S.T.; Lam, L. FRP Strengthened RC Structures; John Wiley & Sons: Chichester, UK, 2002. [Google Scholar]
  3. Wu, Y.F.; Jiang, C. Quantification of bond-slip relationship for externally bonded FRP-to-concrete joints. J. Compos. Constr. 2013, 17, 673–686. [Google Scholar] [CrossRef]
  4. Van Gemert, D. Force transfer in epoxy bonded steel/concrete joints. Int. J. Adhes. Adhes. 1980, 1, 67–72. [Google Scholar] [CrossRef]
  5. Holzenkämpfer, P. IngenieurmModelle des Verbunds Geklebter Bewehrung für Betonbauteile; IBMB: Braunschweig, Germany, 1994. [Google Scholar]
  6. Tanaka, T. Shear Resisting Mechanism of Reinforced Concrete Beams with CFS as Shear Reinforcement. Ph.D. Thesis, Hokkaido University, Sapporo, Japan, 1996. [Google Scholar]
  7. Yoshizawa, H. Analysis of debonding fracture properties of CFS strengthened RC member subject to tension. In Proceedings of the 3rd International Symposium on Non-Metallic (FRP) Reinforcement for Concrete Structures, Sapporo, Japan, 14–16 October 1997; Japan Concrete Institute: Tokyo, Japan, 1997; pp. 287–294. [Google Scholar]
  8. Maeda, T.; Asano, Y.; Sato, Y.; Ueda, T.; Kakuta, Y. A study on bond mechanism of carbon fiber sheet. In Proceedings of the 3rd International Symposium on Non-Metallic (FRP) Reinforcement for Concrete Structures, Sapporo, Japan, 14–16 October 1997; Japan Concrete Institute: Tokyo, Japan, 1997; Volume 1, pp. 285–297. [Google Scholar]
  9. Neubauer, U.; Rostasy, F.S. Design aspects of concrete structures strengthened with externally bonded CFRP-plates. In Proceedings of the Seventh International Conference on Structural Faults and Repair, London, UK, 8–10 July 1997; Engineering Technics Press: Edinburgh, UK, 1997; Volume 2, pp. 109–118. [Google Scholar]
  10. Khalifa, A.; Gold, W.J.; Nanni, A.; MI, A.A. Contribution of externally bonded FRP to shear capacity of RC flexural members. J. Compos. Constr. 1998, 2, 195–202. [Google Scholar] [CrossRef]
  11. Niedermeier, R. Envelope Line of Tensile Forces While Using Externally Bonded Reinforcement. Ph.D. Thesis, Technical University of Munich, Munich, Germany, 2000. [Google Scholar]
  12. Chen, J.F.; Teng, J.G. Anchorage strength models for FRP and steel plates bonded to concrete. J. Struct. Eng. 2001, 127, 784–791. [Google Scholar] [CrossRef]
  13. Yang, Y.X.; Yue, Q.R.; Hu, Y.C. Experimental study on bond performance between carbon fiber sheets and concrete. J. Build. Struct. 2001, 22, 36–42. (In Chinese) [Google Scholar]
  14. Japan Concrete Institute (JCI). Technical Report of Technical Committee on Retrofit Technology. In Proceedings of the International Symposium on the Latest Achievement of Technology and Research on Retrofitting Concrete Structures; Japan Concrete Institute (JCI): Tokyo, Japan, 2003. [Google Scholar]
  15. Monti, G.; Renzelli, M.; Luciani, P. FRP adhesion in uncracked and cracked concrete zones. In Proceedings of the 6th International Symposium on FRP Reinforcement for Concrete Structures (FRPRCS-6), Singapore, 8–10 July 2003; pp. 183–192. [Google Scholar] [CrossRef]
  16. Kanakubo, T.; Furuta, T.; Fukuyama, H. Bond strength between fiber-reinforced polymer laminates and concrete. In Proceedings of the 6th International Symposium on FRP Reinforcement for Concrete Structures (FRPRCS-6), Singapore, 8–10 July 2003; pp. 133–142. [Google Scholar] [CrossRef]
  17. Dai, J.; Ueda, T.; Sato, Y. Development of the Nonlinear Bond Stress–Slip Model of Fiber Reinforced Plastics Sheet–Concrete Interfaces with a Simple Method. J. Compos. Constr. 2005, 9, 52–62. [Google Scholar] [CrossRef]
  18. Lu, X.Z.; Teng, J.G.; Ye, L.P.; Jiang, J.J. Bond–slip models for FRP sheets/plates bonded to concrete. Eng. Struct. 2005, 27, 920–937. [Google Scholar] [CrossRef]
  19. Wu, Z.; Islam, S.M.; Said, H. A three-parameter bond strength model for FRP-concrete interface. J. Reinf. Plast. Compos. 2009, 28, 2309–2323. [Google Scholar] [CrossRef]
  20. Zhou, Y.W. Analytical and Experimental Study on the Strength and Ductility of FRP-Reinforced High Strength Concrete Beam. Ph.D. Thesis, Dalian University of Technology, Dalian, China, 2009. [Google Scholar]
  21. Lin, J.P.; Wu, Y.F.; Smith, S.T. Width factor for externally bonded FRP-to-concrete joints. Constr. Build. Mater. 2017, 155, 818–829. [Google Scholar] [CrossRef]
  22. Lu, X.; Ye, L.; Teng, J.; Zhuang, J. Bond-slip model for FRP-to-concrete interface. Jianzhu Jiegou Xuebao J. Build. Struct. 2005, 26, 10–18. [Google Scholar]
  23. Zhou, Y.; Zheng, S.; Huang, Z.; Sui, L.; Chen, Y. Explicit Neural Network Model for Predicting FRP-Concrete Interfacial Bond Strength Based on a Large Database. Compos. Struct. 2020, 240, 111998. [Google Scholar] [CrossRef]
  24. Chen, S.Z.; Zhang, S.Y.; Han, W.S.; Wu, G. Ensemble learning based approach for FRP-concrete bond strength prediction. Constr. Build. Mater. 2021, 302, 124230. [Google Scholar] [CrossRef]
  25. Zhang, F.; Wang, C.; Liu, J.; Zou, X.; Sneed, L.H.; Bao, Y.; Wang, L. Prediction of FRP-concrete interfacial bond strength based on machine learning. Eng. Struct. 2023, 274, 115156. [Google Scholar] [CrossRef]
  26. Su, M.; Zhong, Q.; Peng, H.; Li, S. Selected machine learning approaches for predicting the interfacial bond strength between FRPs and concrete. Constr. Build. Mater. 2021, 270, 121456. [Google Scholar] [CrossRef]
  27. Vu, D.T.; Hoang, N.D. Punching shear capacity estimation of FRP-reinforced concrete slabs using a hybrid machine learning approach. Struct. Infrastruct. Eng. 2016, 12, 1153–1161. [Google Scholar] [CrossRef]
  28. Jahangir, H.; Eidgahee, D.R. A new and robust hybrid artificial bee colony algorithm–ANN model for FRP-concrete bond strength evaluation. Compos. Struct. 2021, 257, 113160. [Google Scholar] [CrossRef]
  29. Mahjoubi, S.; Meng, W.; Bao, Y. Logic-guided neural network for predicting steel-concrete interfacial behaviors. Expert Syst. Appl. 2022, 198, 116820. [Google Scholar] [CrossRef]
  30. Kim, B.; Lee, D.E.; Hu, G.; Natarajan, Y.; Preethaa, S.; Rathinakumar, A.P. Ensemble machine learning-based approach for predicting of FRP–concrete interfacial bonding. Mathematics 2022, 10, 231. [Google Scholar] [CrossRef]
  31. Mukhtar, F.M.; Faysal, R.M. A review of test methods for studying the FRP-concrete interfacial bond behavior. Constr. Build. Mater. 2018, 169, 877–887. [Google Scholar] [CrossRef]
  32. GB 50010-2010; Code for design of concrete structures. China Architecture & Building Press: Beijing, China, 2010.
  33. Nevergrad—A gradient-Free Optimization Platform. Available online: https://facebookresearch.github.io/nevergrad/ (accessed on 26 March 2025).
  34. Bennet, P.; Doerr, C.; Moreau, A.; Rapin, J.; Teytaud, F.; Teytaud, O. Nevergrad: Black-box optimization platform. ACM SIGEVOlution 2021, 14, 8–15. [Google Scholar] [CrossRef]
  35. Hansen, N.; Ostermeier, A. Completely Derandomized Self-Adaptation in Evolution Strategies. Evol. Comput. 2001, 9, 159–195. [Google Scholar] [CrossRef] [PubMed]
  36. Storn, R.; Price, K. Differential Evolution—A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces. J. Glob. Optim. 1997, 11, 341–359. [Google Scholar] [CrossRef]
  37. Kennedy, J.; Eberhart, R. Particle Swarm Optimization. In Proceedings of the IEEE International Conference on Neural Networks (ICNN’95), Perth, WA, Australia, 27 November–1 December 1995. [Google Scholar] [CrossRef]
  38. Bergstra, J.; Bengio, Y. Random Search for Hyper-Parameter Optimization. J. Mach. Learn. Res. 2012, 13, 281–305. [Google Scholar]
  39. Lemieux, C. Financial Applications. In Monte Carlo and Quasi-Monte Carlo Sampling; Springer Series in Statistics; Springer: New York, NY, USA, 2009; pp. 1–54. [Google Scholar] [CrossRef]
  40. Cauwet, M.-L.; Couprie, C.; Dehos, J.; Luc, P.; Rapin, J.; Riviere, M.; Teytaud, F.; Teytaud, O.; Usunier, N. Fully Parallel Hyperparameter Search: Reshaped Space-Filling. In Proceedings of the 37th International Conference on Machine Learning, PMLR, Online, 13–18 July 2020; Volume 119, pp. 1338–1348. Available online: https://proceedings.mlr.press/v119/cauwet20a.html (accessed on 18 March 2025).
  41. Rapin, J.; Gallagher, M.; Kerschke, P.; Preuss, M.; Teytaud, O. Exploring the MLDA benchmark on the nevergrad platform. In Proceedings of the Genetic and Evolutionary Computation Conference Companion, Prague, Czech Republic, 13–17 July 2019; pp. 1888–1896. [Google Scholar] [CrossRef]
  42. Raponi, E.; Rakotonirina Carraz, N.; Rapin, J.; Doerr, C.; Teytaud, O. Optimizing with Low Budgets: A Comparison on the Black-box Optimization Benchmarking Suite and OpenAI Gym. IEEE Trans. Evol. Comput. 2025, 29, 91–101. [Google Scholar] [CrossRef]
  43. Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar] [CrossRef]
  44. Zhou, X.; Duan, F.; Liu, W.; Shi, C.; Xie, B.; Yao, Z. Research on Prediction of Rheological Properties of Steel-Polypropylene Fiber UHPC Mortar Based on Ensemble Machine Learning. Constr. Build. Mater. 2025, 472, 140833. [Google Scholar] [CrossRef]
  45. Zhou, J.; Qiu, Y.; Zhu, S.; Armaghani, D.J.; Khandelwal, M.; Mohamad, E.T. Estimation of the TBM Advance Rate under Hard Rock Conditions Using XGBoost and Bayesian Optimization. Undergr. Space 2021, 6, 506–515. [Google Scholar] [CrossRef]
  46. Le, L.T.; Nguyen, H.; Zhou, J.; Dou, J.; Moayedi, H. Estimating the Heating Load of Buildings for Smart City Planning Using a Novel Artificial Intelligence Technique PSO-XGBoost. Appl. Sci. 2019, 9, 2714. [Google Scholar] [CrossRef]
  47. Zhou, J.; Qiu, Y.; Zhu, S.; Armaghani, D.J.; Li, C.; Nguyen, H.; Yagiz, S. Optimization of Support Vector Machine through the Use of Metaheuristic Algorithms in Forecasting TBM Advance Rate. Eng. Appl. Artif. Intell. 2021, 97, 104015. [Google Scholar] [CrossRef]
  48. Chen, Y.; Khandelwal, M.; Onifade, M.; Zhou, J.; Lawal, A.I.; Bada, S.O.; Genc, B. Predicting the Hardgrove Grindability Index Using Interpretable Decision Tree-Based Machine Learning Models. Fuel 2025, 384, 133953. [Google Scholar] [CrossRef]
  49. Zhou, J.; Chen, Y.; Li, C.; Qiu, Y.; Huang, S.; Tao, M. Machine Learning Models to Predict the Tunnel Wall Convergence. Transp. Geotech. 2023, 41, 101022. [Google Scholar] [CrossRef]
  50. Li, E.; Zhang, N.; Xi, B.; Zhou, J.; Gao, X. Compressive Strength Prediction and Optimization Design of Sustainable Concrete Based on Squirrel Search Algorithm-Extreme Gradient Boosting Technique. Front. Struct. Civ. Eng. 2023, 17, 1310–1325. [Google Scholar] [CrossRef]
  51. Zhou, J.; Zhang, R.; Qiu, Y.; Khandelwal, M. A True Triaxial Strength Criterion for Rocks by Gene Expression Programming. J. Rock Mech. Geotech. Eng. 2023, 15, 2508–2520. [Google Scholar] [CrossRef]
  52. Zhang, R.; Zhou, J. Predicting the Minimum Horizontal Principal Stress Using Genetic Expression Programming and Borehole Breakout Data. J. Rock Mech. Geotech. Eng. 2024, in press. [CrossRef]
  53. Zhang, Y.L.; Qiu, Y.G.; Armaghani, D.J.; Monjezi, M.; Zhou, J. Enhancing Rock Fragmentation Prediction in Mining Operations: A Hybrid GWO-RF Model with SHAP Interpretability. J. Cent. S. Univ. 2024, 31, 2916–2929. [Google Scholar] [CrossRef]
  54. Shapley, L.S. Stochastic Games. Proc. Natl. Acad. Sci. USA 1953, 39, 1095–1100. [Google Scholar] [CrossRef]
  55. Antwarg, L.; Miller, R.M.; Shapira, B.; Rokach, L. Explaining Anomalies Detected by Autoencoders Using Shapley Additive Explanations. Expert Syst. Appl. 2021, 186, 115736. [Google Scholar] [CrossRef]
Figure 1. Data distribution and feature correlation analyses.
Figure 1. Data distribution and feature correlation analyses.
Materials 18 02868 g001
Figure 2. Structure of the XGBoost bond-strength prediction model.
Figure 2. Structure of the XGBoost bond-strength prediction model.
Materials 18 02868 g002
Figure 3. Hyperparameter optimization process of the XGBoost model: (a) variation in the best CV_Avg RMSE, (b) optimization time of optimizers, (c) comprehensive comparison of optimizers’ predictive performance, (d) variation in the objective value during the TwoPointsDE optimization process, and (e) hyperparameter optimization path of TwoPointsDE (top 100 ranked sets).
Figure 3. Hyperparameter optimization process of the XGBoost model: (a) variation in the best CV_Avg RMSE, (b) optimization time of optimizers, (c) comprehensive comparison of optimizers’ predictive performance, (d) variation in the objective value during the TwoPointsDE optimization process, and (e) hyperparameter optimization path of TwoPointsDE (top 100 ranked sets).
Materials 18 02868 g003aMaterials 18 02868 g003b
Figure 4. Test set prediction results of the Nevergrad-XGBoost model.
Figure 4. Test set prediction results of the Nevergrad-XGBoost model.
Materials 18 02868 g004
Figure 5. Scatter plot of the prediction results of the existing bond strength models on the test set [3,4,5,8,9,10,11,12,13,14,15,16,17,18,19,20].
Figure 5. Scatter plot of the prediction results of the existing bond strength models on the test set [3,4,5,8,9,10,11,12,13,14,15,16,17,18,19,20].
Materials 18 02868 g005
Figure 6. SHAP global explanation: (a) SHAP summary plot and (b) SHAP scatter plot.
Figure 6. SHAP global explanation: (a) SHAP summary plot and (b) SHAP scatter plot.
Materials 18 02868 g006
Figure 7. Shap force plot.
Figure 7. Shap force plot.
Materials 18 02868 g007
Table 1. Existing bond-strength models.
Table 1. Existing bond-strength models.
ReferenceModel
Van Gemert [4] P u = 0.5 b f L f t
Holzenkämpfer [5] P u = b f G f E f t f    G f = c f f t ,    c f = 0.204   mm
Tanaka [6] P u = τ a b f L    τ a = 6.13 ln L
Yoshizawa [7] P u = τ a b f L    τ a = 5.88 L 0.669
Maeda et al. [8] P u = τ a b f L e , w h e r e L e = L i f L e > L
L e = e 6.13 0.58 ln ( E f t f )    τ a = 110.2 × 10 6 E f t f
Neubauer and Rostasy [9] P u = 0.64 κ w b f f t E f t f i f L L e 0.64 κ w b f f t E f t f L L e 2 L L e i f L < L e
L e = E f t f 2 f t    κ w = 1.123 2 b f / b c 1 + b f / 400
Khalifa et al. [10] P u = τ a b f L e , w h e r e L e = L i f L e > L
L e = e 6.13 0.58 ln ( E f t f )    τ a = 110.2 × 10 6 E f t f f c 42 2 / 3
Niedermeier [11] P u = 0.78 b f G f E f t f i f L L e 0.78 b f G f E f t f L L e 2 L L e i f L < L e
L e = E f t f 4 f t    G f = c f κ w 2 f t    κ w = 1.123 2 b f / b c 1 + b f / 400
Chen and Teng [12] P u = 0.427 b f L e β w f c i f L L e 0.427 b f L e β w f c sin π L 2 L e i f L < L e
L e = E f t f f c    β w = 2 b f / b C 1 + b f / b C
Yang et al. [13] P u = ( 0.5 + 0.08 0.01 E f t f / f t ) τ a b f L e
τ a = 0.5 f t    L e = 100   mm
ISO model [14] P u = τ a b f L e i f L L e τ a b f L i f L < L e
L e = 0.125 ( E f t f ) 0.57    τ a = 0.93 f c 0.44
Monti et al. [15] P u = b f E f t f τ max 3 i f L L e b f E f t f τ max 3 sin π L 2 L e i f L < L e
L e = E f t f 4 τ max    τ max = 1.8 k b f t    k b = 1.5 2 b f / b c 1 + b f / 100
Kanakubo et al. [16] P u = 1.1 f c 0.2 b f L e i f L b > L e 0.7 cos L b L e π + 1.8 f c 0.2 b f L b i f L b < L e
L e = 0.7 E f t f f c 0.2
Dai et al. [17] P u = b f 2 E f t f G f i f b f < 100   mm ( b f + 2 Δ b f ) 2 E f t f G f i f b f 100   mm
G f = 0.514 f c 0.236 , Δ b f = 3.7   mm    L e = 0.74 E f t f f c 0.236
Lu et al. [18] P u = b f 2 E f t f G f i f L L e b f 2 E f t f G f L L e 2 L L e i f L < L e
L e = a 0 + 1 2 λ 1 ln λ 1 + λ 2 tan ( λ 2 a 0 ) λ 1 λ 2 tan ( λ 2 a 0 )
a o = 1 λ 2 sin 1 0.99 s f s 0 s f , s f = 2 G f τ max
s 0 = 0.0195 κ w f t , G f = 0.308 κ w 2 f t , τ max = 1.5 κ w f t
λ 1 = τ max s 0 E f t f , λ 2 = τ max ( s f s 0 ) E f t f    κ w = 2.25 b f / b c 1.25 + b f / b c
Wu et al. [19] P u = 0.585 b f f c 0.1 κ w ( E f t f ) 0.54 i f L L e 0.585 b f f c 0.1 κ w ( E f t f ) 0.54 L L e 1.2 i f L < L e
L e = 0.395 ( E f t f ) 0.54 / f c 0.09    κ w = 2.25 b f / b C 1.25 + b f / b C
Zhou [20] P u = β l b f 2 E f t f G f    L e = 1.6841 E f t f f c 2 / 3
β l = 1 i f L L e L L e 2 L L e i f L < L e    β w = 2.9 b f / b C 0.6 + b f / b C
G f = 0.0498 β w 2 f c
Wu and Jiang [3]
Lin et al. [21]
P u ( L ) = α β E f t f b f κ L    L e = 2 ln 1 + δ 1 δ β
κ L = η 1 η 2 sinh ( 1 η 2 L / β ) 1 + η cosh ( 1 η 2 L / β )
α = 0.094 f c 0.026 , β = 0.134 ( E f t f ) 0.5 κ w f c 0.082
η = 3.61 e 0.4454 L β + 4.11 e 0.3835 L β
α β = 0.703 ( E f t f ) 0.5 f c 0.108 κ w
κ w = 1 + f c 0.385 [ 8 ( E f t f ) 0.438 + 0.001 ] ( 1 b f / b c ) 0.5 1 + 0.01 b f 1.7 [21]
Note: P u is the bond strength of FRP-concrete interface; b f is the width of FRP sheets; L is the bonded length; f t is the tensile strength of concrete; G f is the fracture energy of interface; E f is the elastic modulus of the FRP sheets; τ a is the interfacial shear stress; L e is the effective bond length; t f is the thickness of FRP sheets; b c is the width of concrete substrate; κ w is the width factor; f c is the compressive strength of concrete.
Table 2. Statistical information of the database.
Table 2. Statistical information of the database.
ParametersMinMaxMeanQ1MedianQ3
bc (mm)80500144.30 100150150
fc′ (MPa)875.539.54 2636.548.56
Ef (GPa)22.5425.1204.80 152.2230248.3
tf (mm)0.08340.51 0.1670.1691
bf (mm)1015057.52 405070
Lf (mm)20400172.97 100150250
Pu (kN)2.456.517.80 10.56515.621.955
Table 3. Hyperparameter search space for XGBoost.
Table 3. Hyperparameter search space for XGBoost.
HyperparametersMeaningsSearch Ranges
n_estimatorsNumber of weak learners (decision trees)[50, 500]
max_depthMaximum depth of each tree[1, 50]
learning_rateLearning rate controls the step size of parameter updates during training[0.001, 0.5]
Table 4. Detailed results of the optimizer hyperparameter optimization.
Table 4. Detailed results of the optimizer hyperparameter optimization.
OptimizerOptimization
Time(s)
n_EstimatorsLearning_RateMax_DepthCV_Avg_R2CV_Avg_
RMSE
CV_Avg_
MAE
CMA443.252850.373695323 320.91812 2.87842 1.87640
TwoPointsDE361.25900.127378457 80.91915 2.85207 1.84678
PSO594.532120.248822202 30.91924 2.85821 1.93150
RandomSearch573.821750.208228973 50.91740 2.87593 1.88183
ScrHammersley538.423920.372326172 130.918372.875371.87154
DiscreteOnePlusOne459.551930.291644820 100.918692.867691.86871
NGOpt417.83480.380325336 130.918532.873401.87165
Table 5. Comparison of the prediction performance of bond strength models.
Table 5. Comparison of the prediction performance of bond strength models.
ModelR2RMSEMAE
Empirical or semi-empirical formulasMaeda et al. [8]0.78985.19353.8411
Neubauer and Rostasy [9]0.74405.73134.2115
Niedermeier [11]0.79555.12223.6248
Chen and Teng [12]0.73915.78613.9616
Kanakubo et al. [16]0.71106.08964.2195
Lu et al. [18]0.76265.51903.7739
Zhou [20]0.76605.48003.8249
Machine learning modelANN (Zhou et al. [23])0.9283.584-
This paper0.97261.87451.3857
Table 6. SHAP explanation details for a single sample.
Table 6. SHAP explanation details for a single sample.
FeatureFeature ValueSHAP Value
bc150−0.0316
fc74.670.6576
Ef73−4.4544
tf0.169−2.4096
bf1004.8879
Lf100−1.8365
Base value17.7713
Predicted value14.5847
True value15.14
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, Y.; Zhang, Y.; Li, C.; Zhou, J. Application of XGBoost Model Optimized by Multi-Algorithm Ensemble in Predicting FRP-Concrete Interfacial Bond Strength. Materials 2025, 18, 2868. https://doi.org/10.3390/ma18122868

AMA Style

Chen Y, Zhang Y, Li C, Zhou J. Application of XGBoost Model Optimized by Multi-Algorithm Ensemble in Predicting FRP-Concrete Interfacial Bond Strength. Materials. 2025; 18(12):2868. https://doi.org/10.3390/ma18122868

Chicago/Turabian Style

Chen, Yuxin, Yulin Zhang, Chuanqi Li, and Jian Zhou. 2025. "Application of XGBoost Model Optimized by Multi-Algorithm Ensemble in Predicting FRP-Concrete Interfacial Bond Strength" Materials 18, no. 12: 2868. https://doi.org/10.3390/ma18122868

APA Style

Chen, Y., Zhang, Y., Li, C., & Zhou, J. (2025). Application of XGBoost Model Optimized by Multi-Algorithm Ensemble in Predicting FRP-Concrete Interfacial Bond Strength. Materials, 18(12), 2868. https://doi.org/10.3390/ma18122868

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop