Grouting Power Prediction Using a Hybrid Model Based on Support Vector Regression Optimized by an Improved Jaya Algorithm
Abstract
1. Introduction
2. Literature Review
- (1)
- The proposed model not only considers the characteristics of grouting power series but integrates the advantages of four algorithms to remedy the deficiencies of single models, and good prediction accuracy is obtained.
- (2)
- An IJaya algorithm is proposed to optimize the hyperparameters of SVR. In the IJaya algorithm, tent chaotic mapping has been employed in the Jaya algorithm to preserve statistical population diversity and prevent the algorithm from sticking on local optima. Also, Lévy flights is introduced to the statistical population updating phase of the basic Jaya algorithm to enhance search capabilities and increase the probability of finding the optimal solution.
- (3)
- The EWT is adopted as a data preprocessor to decompose the grouting power series into specific subseries and one residual series to extract meaningful information from the grouting power series. The residual is regarded as an uncorrelated white noise series and discarded to denoise the original grouting power series. The rest subseries are smoother and more predictable, contributing to obtain more precise prediction results.
- (4)
- The PACF is applied to calculate the partial correlation between the data in each subseries and identify the optimal input variables for predictors.
3. Research Framework
- Step 1.
- Collect the original grouting power series based on the grouting real-time monitoring system [39]. Utilize the EWT to decompose the obtained time series into a specific number of subseries and one residual series adaptively to extract meaningful information from them and reduce modelling complexity. Denoise the original grouting power series by discarding the uncorrelated residual series.
- Step 2.
- Apply the PACF to analyze the correlation between the data in each subseries and determine the optimal input variables objectively.
- Step 3.
- Utilize the SVR model to forecast the decomposed subseries; employ the IJaya algorithm to optimize the hyperparameters of the built SVR models. The constructed IJaya-SVR model can thus achieve better prediction accuracy.
- Step 4.
- Sum the prediction results of the subseries to formulate an ensemble forecasting result for the original series.
- Step 5.
- Apply the hybrid model established by using the methodologies mentioned in steps 1–4 to an actual project. The grouting power variation range and trend can be predicted and analyzed. The applicability and advantages of the proposed hybrid model are discussed and verified in comparison with other prediction models.
4. Methodology
4.1. EWT
4.2. PACF
4.3. SVR Optimized by the IJaya Algorithm
- Generate the chaotic variable of .where k is the serial number of the k-th statistical population and and stand for two extreme values of the i-th variable, which are the minimum and the maximum, respectively.
- Apply tent chaotic mapping to generate the chaotic sequence:
- Map the chaotic sequence to the search space:
- Step 1.
- Parameter initializationSet the number of design variables, Nvar, the statistical population size Npop, the maximum number of iterations, Nmax, and the lower and upper bounds of the design variables (lb, ub).
- Step 2.
- Hyperparameter (C, ε, g) optimizationInitialize the IJaya statistical population, then update the statistical population when the objective function value is better. When iteration k > Nmax, exit the calculation and obtain the optimal (C, ε, g).
- Step 3.
- Training and predictingBased on the hyperparameters obtained from step 2, the training and prediction models are constructed for grouting power prediction. Then the predicted grouting power, accuracy, and evaluation indices are calculated.
5. Case Study
5.1. Data Collection
5.2. Evaluation Criteria
5.3. Simulation
5.3.1. Decomposition Process
5.3.2. PACF Results
5.3.3. Prediction and Integration Processes
6. Discussion
7. Conclusions
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Zhu, Y.; Wang, X.; Deng, S.; Chen, W.; Shi, Z.; Xue, L.; Lv, M. Grouting process simulation based on 3D fracture network considering fluid-structure interaction. Appl. Sci. 2019, 9, 667. [Google Scholar] [CrossRef] [Scilit]
- Warner, J. Practical Handbook of Grouting: Soil, Rock, and Structures; John Wiley & Sons: New York, NY, USA, 2004. [Google Scholar]
- Xia, K. Grouting Technology Collected Works; China Water & Power Press: Beijing, China, 2016; pp. 52–57. [Google Scholar]
- Tran, H.-H.; Hoang, N.-D. An Artificial Intelligence Approach for Groutability Estimation Based on Autotuning Support Vector Machine. J. Constr. Eng. 2014, 2014, 109184. [Google Scholar] [CrossRef] [Scilit]
- Hoang, N.D.; Bui, D.T.; Liao, K.W. Groutability estimation of grouting processes with cement grouts using Differential Flower Pollination Optimized Support Vector Machine. Appl. Soft Comput. J. 2016, 45, 173–186. [Google Scholar] [CrossRef] [Scilit]
- Deng, S.; Wang, X.; Zhu, Y.; Lv, F.; Wang, J. Hybrid Grey Wolf Optimization Algorithm-Based Support Vector Machine for Groutability Prediction of Fractured Rock Mass. J. Comput. Civ. Eng. 2019, 33, 04018065. [Google Scholar] [CrossRef] [Scilit]
- Yang, C.P. Estimating cement take and grout efficiency on foundation improvement for Li-Yu-Tan dam. Eng. Geol. 2004, 75, 1–14. [Google Scholar] [CrossRef] [Scilit]
- Zhang, L.; Li, Q.; Song, Y. Neural network-based experimental study on shaft water sealing by grouting. Int. Geosci. Remote Sens. Symp. 2007, 3142–3145. [Google Scholar] [CrossRef] [Scilit]
- Fan, G.; Zhong, D.; Wang, J.; Ren, B. Cement Take Evaluation and Prediction based on Empirical Relationships and Support Vector Regression. In Proceedings of the 2016 5th International Conference on Energy and Environmental Protection, Shenzhen, China, 17–18 September 2016; pp. 699–704. [Google Scholar]
- Öge, İ.F. Prediction of cementitious grout take for a mine shaft permeation by adaptive neuro-fuzzy inference system and multiple regression. Eng. Geol. 2017, 228, 238–248. [Google Scholar] [CrossRef] [Scilit]
- Li, X.; Zhong, D.; Ren, B.; Fan, G.; Cui, B. Prediction of curtain grouting efficiency based on ANFIS. Bull. Eng. Geol. Environ. 2019, 78, 281–309. [Google Scholar] [CrossRef] [Scilit]
- Attar, N.F.; Pham, Q.B.; Nowbandegani, S.F.; Rezaie-Balf, M.; Fai, C.M.; Ahmed, A.N.; Pipelzadeh, S.; Dung, T.D.; Nhi, P.T.T.; Khoi, D.N.; et al. Enhancing the prediction accuracy of data-driven models for monthly streamflow in Urmia Lake Basin based upon the autoregressive conditionally heteroskedastic time-series model. Appl. Sci. 2020, 10, 571. [Google Scholar] [CrossRef] [Scilit]
- Asadi, R.; Regan, A.C. A spatio-temporal decomposition based deep neural network for time series forecasting. Appl. Soft Comput. J. 2020, 87, 105963. [Google Scholar] [CrossRef] [Scilit]
- Cao, E.; Bao, T.; Gu, C.; Li, H.; Liu, Y.; Hu, S. A Novel Hybrid Decomposition—Ensemble Prediction Model for Dam Deformation. Appl. Sci. 2020, 10, 5700. [Google Scholar] [CrossRef] [Scilit]
- Yang, H.F.; Chen, Y.P.P. Hybrid deep learning and empirical mode decomposition model for time series applications. Expert Syst. Appl. 2019, 120, 128–138. [Google Scholar] [CrossRef] [Scilit]
- Shakeel, A.; Tanaka, T.; Kitajo, K. Time-series prediction of the oscillatory phase of eeg signals using the least mean square algorithm-based ar model. Appl. Sci. 2020, 10, 3616. [Google Scholar] [CrossRef] [Scilit]
- Xie, T.; Zhang, G.; Liu, H.; Liu, F.; Du, P. A hybrid forecasting method for solar output power based on variational mode decomposition, deep belief networks and auto-regressive moving average. Appl. Sci. 2018, 8, 1910. [Google Scholar] [CrossRef] [Scilit]
- Azadeh, A.; Ghaderi, S.F.; Sohrabkhani, S. A simulated-based neural network algorithm for forecasting electrical energy consumption in Iran. Energy Policy 2008, 36, 2637–2644. [Google Scholar] [CrossRef] [Scilit]
- Hong, W.C. Chaotic particle swarm optimization algorithm in a support vector regression electric load forecasting model. Energy Convers. Manag. 2009, 50, 105–117. [Google Scholar] [CrossRef] [Scilit]
- Lian, C.; Zeng, Z.; Yao, W.; Tang, H. Displacement prediction model of landslide based on a modified ensemble empirical mode decomposition and extreme learning machine. Nat. Hazards 2013, 66, 759–771. [Google Scholar] [CrossRef] [Scilit]
- Niu, W.-j.; Feng, Z.-k.; Zeng, M.; Feng, B.-f.; Min, Y.-w.; Cheng, C.-t.; Zhou, J.-z. Forecasting reservoir monthly runoff via ensemble empirical mode decomposition and extreme learning machine optimized by an improved gravitational search algorithm. Appl. Soft Comput. J. 2019, 82, 105589. [Google Scholar] [CrossRef] [Scilit]
- Drucker, H.; Surges, C.J.C.; Kaufman, L.; Smola, A.; Vapnik, V. Support vector regression machines. Adv. Neural Inf. Process. Syst. 1997, 1, 155–161. [Google Scholar]
- Bagheri, M.; Rezaei, H. Reservoir rock permeability prediction using SVR based on radial basis function kernel. Carbonates Evaporites 2019, 34, 699–707. [Google Scholar] [CrossRef] [Scilit]
- Luo, X.; Yuan, X.; Zhu, S.; Xu, Z.; Meng, L.; Peng, J. A hybrid support vector regression framework for streamflow forecast. J. Hydrol. 2019, 568, 184–193. [Google Scholar] [CrossRef] [Scilit]
- Liu, D.; Niu, D.; Wang, H.; Fan, L. Short-term wind speed forecasting using wavelet transform and support vector machines optimized by genetic algorithm. Renew. Energy 2014, 62, 592–597. [Google Scholar] [CrossRef] [Scilit]
- Shiu, M.C.; Wei, L.Y.; Liu, J.W.; Huang, D.Y.; Tu, C.C.; Liao, K.H. A hybrid one-step-Ahead time series model based on GA-SVR and EMD for forecasting electricity loads. J. Appl. Sci. Eng. 2017, 20, 467–476. [Google Scholar] [CrossRef]
- Cheng, H.; Ding, X.; Zhou, W.; Ding, R. A hybrid electricity price forecasting model with Bayesian optimization for German energy exchange. Int. J. Electr. Power Energy Syst. 2019, 110, 653–666. [Google Scholar] [CrossRef] [Scilit]
- Dash, P.K.; Majumder, I.; Nayak, N.; Bisoi, R. Point and Interval Solar Power Forecasting Using Hybrid Empirical Wavelet Transform and Robust Wavelet Kernel Ridge Regression. Nat. Resour. Res. 2020, 29, 2813–2841. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Q.; Zhang, J. Short-Term Load Forecasting Method Based on EWT and IDBSCAN. J. Electr. Eng. Technol. 2020, 15, 635–644. [Google Scholar] [CrossRef] [Scilit]
- Hu, J.; Wang, J. Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression. Energy 2015, 93, 1456–1466. [Google Scholar] [CrossRef] [Scilit]
- Huang, N.; Yuan, C.; Cai, G.; Xing, E. Hybrid short term wind speed forecasting using variational mode decomposition and a weighted regularized extreme learning machine. Energies 2016, 9. [Google Scholar] [CrossRef] [Scilit]
- Xie, T.; Zhang, G.; Hou, J.; Xie, J.; Lv, M.; Liu, F. Hybrid forecasting model for non-stationary daily runoff series: A case study in the Han River Basin, China. J. Hydrol. 2019, 577, 123915. [Google Scholar] [CrossRef] [Scilit]
- Wang, J.; Zhong, D.; Adeli, H.; Wang, D.; Liu, M. Smart bacteria-foraging algorithm-based customized kernel support vector regression and enhanced probabilistic neural network for compaction quality assessment and control of earth-rock dam. Expert Syst. 2018, 35, e12357. [Google Scholar] [CrossRef] [Scilit]
- Venkata Rao, R. Jaya: A simple and new optimization algorithm for solving constrained and unconstrained optimization problems. Int. J. Ind. Eng. Comput. 2016, 7, 19–34. [Google Scholar] [CrossRef] [Scilit]
- Sawulski, J.; Ławryńczuk, M. Optimization of control strategy for a low fuel consumption vehicle engine. Inf. Sci. 2019, 493, 192–216. [Google Scholar] [CrossRef] [Scilit]
- Xu, S.; Wang, Y.; Wang, Z. Parameter estimation of proton exchange membrane fuel cells using eagle strategy based on JAYA algorithm and Nelder-Mead simplex method. Energy 2019, 173, 457–467. [Google Scholar] [CrossRef] [Scilit]
- Suraj, S.; Sinha, R.K.; Ghosh, S. Jaya Based ANFIS for Monitoring of Two Class Motor Imagery Task. IEEE Access. 2016, 4, 9273–9282. [Google Scholar] [CrossRef] [Scilit]
- Elattar, E.E.; ElSayed, S.K. Modified JAYA algorithm for optimal power flow incorporating renewable energy sources considering the cost, emission, power loss and voltage profile improvement. Energy 2019, 178, 598–609. [Google Scholar] [CrossRef] [Scilit]
- Zhong, D.H.; Yan, F.G.; Li, M.C.; Huang, C.X.; Fan, K.; Tang, J.F. A Real-Time Analysis and Feedback System for Quality Control of Dam Foundation Grouting Engineering. Rock Mech. Rock Eng. 2015, 48, 1947–1968. [Google Scholar] [CrossRef] [Scilit]
- Gilles, J. Empirical wavelet transform. IEEE Trans. Signal. Process. 2013, 61, 3999–4010. [Google Scholar] [CrossRef] [Scilit]
- Xie, G.; Qian, Y.; Yang, H. Forecasting container throughput based on wavelet transforms within a decomposition-ensemble methodology: A case study of China. Marit. Policy Manag. 2019, 46, 178–200. [Google Scholar] [CrossRef] [Scilit]
- Mi, X.; Liu, H.; Li, Y. Wind speed prediction model using singular spectrum analysis, empirical mode decomposition and convolutional support vector machine. Energy Convers. Manag. 2019, 180, 196–205. [Google Scholar] [CrossRef] [Scilit]
- Devi, A.S.; Maragatham, G.; Boopathi, K.; Rangaraj, A.G. Hourly day-ahead wind power forecasting with the EEMD-CSO-LSTM-EFG deep learning technique. Soft Comput. 2020, 7. [Google Scholar] [CrossRef] [Scilit]
- Sun, G.; Chen, T.; Wei, Z.; Sun, Y.; Zang, H.; Chen, S. A carbon price forecasting model based on variational mode decomposition and spiking neural networks. Energies 2016, 9, 54. [Google Scholar] [CrossRef] [Scilit]
- Chou, J.S.; Yang, K.H.; Lin, J.Y. Peak Shear Strength of Discrete Fiber-Reinforced Soils Computed by Machine Learning and Metaensemble Methods. J. Comput. Civ. Eng. 2016, 30, 04016036. [Google Scholar] [CrossRef] [Scilit]
- Wang, J.; Zhong, D.; Wu, B.; Shi, M. Evaluation of Compaction Quality Based on SVR with CFA: Case Study on Compaction Quality of Earth-Rock Dam. J. Comput. Civ. Eng. 2018, 32, 05018001. [Google Scholar] [CrossRef] [Scilit]
- Smola, A.J.; Olkopf, B.S.C.H. A Tutorial On Support Vector Regression. Stat. Comput. 2004, 14, 199–222. [Google Scholar] [CrossRef] [Scilit]
- Alatas, B. Chaotic bee colony algorithms for global numerical optimization. Expert Syst. Appl. 2010, 37, 5682–5687. [Google Scholar] [CrossRef] [Scilit]
- Yu, J.T.; Kim, C.H.; Wadood, A.; Khurshaid, T.; Rhee, S.B. Jaya Algorithm with Self-Adaptive Multi-Population and Lévy Flights for Solving Economic Load Dispatch Problems. IEEE Access 2019, 7, 21372–21384. [Google Scholar] [CrossRef] [Scilit]
- Viswanathan, G.M.; Afanasyevt, V.; Buldyrev, S.V.; Murphyt, E.J.; Princet, P.A.; Stanley, H.E. Levy flight search patterns of wandering albatrosses. Nature 1996, 381, 413–415. [Google Scholar] [CrossRef] [Scilit]
- Mariano, R.S. Comparing Predictive Accuracy AU—Diebold, Francis X. J. Bus. Econ. Stat. 2002, 20, 134–144. [Google Scholar] [CrossRef] [Scilit]











| Data Set | Number | Maximum (MPa·L/min) | Minimum (MPa·L/min) | Mean (MPa·L/min) | Standard Deviation | Median (MPa·L/min) |
|---|---|---|---|---|---|---|
| All samples | 600 | 11.025 | 1.044 | 5.890 | 1.126 | 5.880 |
| Training set | 500 | 10.512 | 1.044 | 5.901 | 1.043 | 5.880 |
| Testing set | 100 | 11.025 | 3.360 | 5.838 | 1.480 | 5.913 |
| Model | RMSE (MPa·L/min) | MAE (MPa·L/min) | MAPE (%) | EC | DM |
|---|---|---|---|---|---|
| EPIJaya-SVR | 0.2672 | 0.2165 | 3.85% | 0.9815 | - |
| EIJaya-SVR | 0.2788 | 0.2252 | 4.00% | 0.9806 | 1.07 |
| IJaya-SVR | 1.1262 | 0.5456 | 8.96% | 0.9527 | 2.62 |
| Jaya-SVR | 1.1579 | 0.5708 | 9.60% | 0.9507 | 2.83 |
| SVR | 1.1340 | 0.7454 | 12.90% | 0.8797 | 3.18 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Xue, L.; Zhu, Y.; Guan, T.; Ren, B.; Tong, D.; Wu, B. Grouting Power Prediction Using a Hybrid Model Based on Support Vector Regression Optimized by an Improved Jaya Algorithm. Appl. Sci. 2020, 10, 7273. https://doi.org/10.3390/app10207273
Xue L, Zhu Y, Guan T, Ren B, Tong D, Wu B. Grouting Power Prediction Using a Hybrid Model Based on Support Vector Regression Optimized by an Improved Jaya Algorithm. Applied Sciences. 2020; 10(20):7273. https://doi.org/10.3390/app10207273
Chicago/Turabian StyleXue, Linli, Yushan Zhu, Tao Guan, Bingyu Ren, Dawei Tong, and Binping Wu. 2020. "Grouting Power Prediction Using a Hybrid Model Based on Support Vector Regression Optimized by an Improved Jaya Algorithm" Applied Sciences 10, no. 20: 7273. https://doi.org/10.3390/app10207273
APA StyleXue, L., Zhu, Y., Guan, T., Ren, B., Tong, D., & Wu, B. (2020). Grouting Power Prediction Using a Hybrid Model Based on Support Vector Regression Optimized by an Improved Jaya Algorithm. Applied Sciences, 10(20), 7273. https://doi.org/10.3390/app10207273
