Comparative Analysis of Ensemble Learning Approaches for Slope Stability Prediction

International Journal of Civil Engineering

© 2024 by SSRG - IJCE Journal

Volume 11 Issue 5

Year of Publication : 2024

Authors : Saurabh Kumar Anuragi, D.Kishan, S.K.Saritha

10.14445/23488352/IJCE-V11I5P116

How to Cite?

Saurabh Kumar Anuragi, D.Kishan, S.K.Saritha, "Comparative Analysis of Ensemble Learning Approaches for Slope Stability Prediction," SSRG International Journal of Civil Engineering, vol. 11,  no. 5, pp. 168-180, 2024. Crossref, https://doi.org/10.14445/23488352/IJCE-V11I5P116

Abstract:

Due to the complex nature of slope engineering, accurately predicting slope stability using traditional techniques can be difficult. It is, therefore, crucial to identify the correct technique for slope stability prediction in order to prevent disasters caused by slope failures. This study provides a comprehensive analysis of three ensemble models: Random Forest (RF), CatBoost, and Stacking. The models were evaluated for a wide range of hyperparameters to find the optimal settings for each model, resulting in the best solution. Six potentially relevant features, including height (H), pore water ratio (ru), unit weight (Ƴ), cohesion (c), slope angle (β) and angle of internal friction (ɸ), were selected as prediction indicators. The generalization ability of classification models is enhanced by using a 5-fold CV. Evaluation indicators such as AUC and accuracy were analyzed, and Stacking was found to outperform the other ensemble models with the highest AUC of 0.898 and accuracy of 0.854. The analysis of engineering examples shows that Stacking is a highly effective tool for predicting slope stability due to its ability to enhance capacity and efficiency in deformation prediction models. This makes it the most accurate tool available for forecasting slope stability. In addition, a comprehensive analysis of parameter sensitivity was conducted to determine the most significant characteristics for predicting slope stability.

Keywords:

Logistic Regression, CatBoost, Slope Stability, Random Forest, Hyperparameters, Optimization, Finite Element Method, Limit Equilibrium.

References:

[1] James Michael Duncan, “State of the Art: Limit Equilibrium and Finite-Element Analysis of Slopes,” Journal of Geotechnical Engineering, vol. 122, no. 7, pp. 577-596, 1996.
[CrossRef] [Google Scholar] [Publisher Link]
[2] S.Y. Liu, L.T. Shao, and H.J. Li, “Slope Stability Analysis Using the Limit Equilibrium Method and Two Finite Element Methods,” Computers and Geotechnics, vol. 63, pp. 291-298, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Y.M. Cheng, T. Lansivaara, and W.B. Wei, “Two-Dimensional Slope Stability Analysis by Limit Equilibrium and Strength Reduction Methods,” Computers and Geotechnics, vol. 34, no. 3, pp. 137-150, 2007.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Fei Zheng et al., “Modified Predictor-Corrector Solution Approach for Efficient Discontinuous Deformation Analysis of Jointed Rock Masses,” International Journal for Numerical and Analytical Methods in Geomechanics, vol. 43, no. 2, pp. 599-624, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Xiaoying Zhuang et al., “A Cover-Based Contact Detection Approach for Irregular Convex Polygons in Discontinuous Deformation Analysis,” International Journal for Numerical and Analytical Methods in Geomechanics, vol. 45, no. 2, pp. 208-233, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[6] H. Zheng, D.F. Liu, and C.G. Li, “Slope Stability Analysis Based on Elasto-Plastic Finite Element Method,” International Journal for Numerical Methods in Engineering, vol. 64, no. 14, pp. 1871-1888, 2005.
[CrossRef] [Google Scholar] [Publisher Link]
[7] D.V. Griffiths, and P.A. Lane, “Slope Stability Analysis by Finite Elements,” Geotechnique, vol. 49, no. 3, pp. 387-403, 1999.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Tamotsu Matsui, and Ka-Ching San, “Finite Element Slope Stability Analysis by Shear Strength Reduction Technique,” Soils and Foundations, vol. 32, no. 1, pp. 59-70, 1992.
[CrossRef] [Google Scholar] [Publisher Link]
[9] X. Li, “Finite Element Analysis of Slope Stability Using a Nonlinear Failure Criterion,” Computers and Geotechnics, vol. 34, no. 3, pp. 127-136, 2007.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Shan Lin et al., “Evaluation and Prediction of Slope Stability Using Machine Learning Approaches,” Frontiers of Structural and Civil Engineering, vol. 15, no. 4, pp. 821-833, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Pijush Samui, “Slope Stability Analysis: A Support Vector Machine Approach,” Environmental Geology, vol. 56, pp. 255-267, 2008.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Min-Yuan Cheng, and Nhat-Duc Hoang, “Slope Collapse Prediction Using Bayesian Framework with K-Nearest Neighbor Density Estimation: Case Study in Taiwan,” Journal of Computing in Civil Engineering, vol. 30, no. 1, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[13] H. Fattahi, “Prediction of Slope Stability Using Adaptive Neuro-Fuzzy Inference System Based on Clustering Methods,” Journal of Mining and Environment, vol. 8, no. 2, pp. 163-177, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Nhat-Duc Hoang, and Dieu Tien Bui, “Slope Stability Evaluation Using Radial Basis Function Neural Network, Least Squares Support Vector Machines, and Extreme Learning Machine,” Handbook of Neural Computation, pp. 333-344, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Sarat Kumar Das et al., “Classification of Slopes and Prediction of Factor of Safety using Differential Evolution Neural Networks,” Environmental Earth Sciences, vol. 64, pp. 201-210, 2011.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Amin Manouchehrian, Javad Gholamnejad, and Mostafa Sharifzadeh, “Development of a Model for Analysis of Slope Stability for Circular Mode Failure Using Genetic Algorithm,” Environmental Earth Sciences, vol. 71, pp. 1267-1277, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Yusuf Erzin, and Tulin Cetin, “The Prediction of the Critical Factor of Safety of Homogeneous Finite Slopes Using Neural Networks and Multiple Regressions,” Computers Geosciences, vol. 51, pp. 305-313, 2013.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Chongchong Qi, and Xiaolin Tang, “Slope Stability Prediction using Integrated Metaheuristic and Machine Learning Approaches: A Comparative Study,” Computers & Industrial Engineering, vol. 118, pp. 112-122, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Dhruva Karir et al., “Stability Prediction of a Natural and Man-Made Slope Using Various Machine Learning Algorithms,” Transportation Geotechnics, vol. 34, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Chongchong Qi et al., “Comparative Study of Hybrid Artificial Intelligence Approaches for Predicting Hanging Wall Stability,” Journal of Computing in Civil Engineering, vol. 32, no. 2, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Min-Yuan Cheng, and Nhat-Duc Hoang, “Typhoon-Induced Slope Collapse Assessment Using a Novel Bee Colony Optimized Support Vector Classifier,” Natural Hazards, vol. 78, pp. 1961-1978, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Nhat-Duc Hoang, and Anh-Duc Pham, “Hybrid Artificial Intelligence Approach Based on Metaheuristic and Machine Learning for Slope Stability Assessment: A Multinational Data Analysis,” Expert Systems with Applications, vol. 46, pp. 60-68, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Behrouz Gordan et al., “Prediction of Seismic Slope Stability through Combination of Particle Swarm Optimization and Neural Network,” Engineering with Computers, vol. 32, pp. 85-97, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Zhenyan Luo et al., “A Novel Artificial Intelligence Technique for Analyzing Slope Stability using PSO-CA Model,” Engineering with Computers, vol. 37, pp. 533-544, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[25] Chongchong Qi, and Xiaolin Tang, “A Hybrid Ensemble Method for Improved Prediction of Slope Stability,” International Journal for Numerical and Analytical Methods in Geomechanics, vol. 42, no. 15, pp. 1823-1839, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Ningthoujam Jibanchand, and Konsam Rambha Devi, “Application of Ensemble Learning in Predicting Shallow Foundation Settlement in Cohesionless Soil,” International Journal of Geotechnical Engineering, vol. 17, no. 3, pp. 234-245, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Lihui Bai et al., “A Machine Learning Ensemble Model for Predicting Pavement Conditions Using Automatic Laser Crack Measurement Data,” International Journal of Pavement Engineering, vol. 24, no. 1, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[28] Jingqi Cui et al., “Composite Interpretability Optimization Ensemble Learning Inversion Surrounding Rock Mechanical Parameters and Support Optimization in Soft Rock Tunnels,” Computers and Geotechnics, vol. 165, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Navid Kardani et al., “Improved Prediction of Slope Stability using a Hybrid Stacking Ensemble Method Based on Finite Element Analysis and Field Data,” Journal of Rock Mechanics and Geotechnical Engineering, vol. 13, no. 1, pp. 188-201, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[30] Lin Wang et al., “Efficient Reliability Analysis of Earth Dam Slope Stability using Extreme Gradient Boosting Method,” Acta Geotechnica, vol. 15, pp. 3135-3150, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[31] Wengang Zhang et al., “Assessment of Basal Heave Stability for Braced Excavations in Anisotropic Clay using Extreme Gradient Boosting and Random Forest Regression,” Underground Space, vol. 7, no. 2, pp. 233-241, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[32] Zhice Fang et al., “A Comparative Study of Heterogeneous Ensemble-Learning Techniques for Landslide Susceptibility Mapping,” International Journal of Geographical Information Science, vol. 35, no. 2, pp. 321-347, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[33] Yang Chen et al., “Predicting Uniaxial Tensile Strength of Expansive Soil with Ensemble Learning Methods,” Computers and Geotechnics, vol. 150, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[34] Gérard Biau, and Erwan Scornet, “A Random Forest Guided Tour,” Test, vol. 25, pp. 197-227, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[35] Jaime Lynn Speiser et al., “A Comparison of Random Forest Variable Selection Methods for Classification Prediction Modelling,” Expert Systems with Applications, vol. 134, pp. 93-101, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[36] Mariana Belgiu, and Lucian Drăguţ, “Random Forest in Remote Sensing: A Review of Applications and Future Directions,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 114, pp. 24-31, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[37] Husein Ali Zeini et al., “Random Forest Algorithm for the Strength Prediction of Geopolymer Stabilized Clayey Soil,” Sustainability, vol. 15, no. 2, pp. 1-15, 2023. [CrossRef] [Google Scholar] [Publisher Link]
[38] Binh Thai Pham et al., “A Novel Hybrid Soft Computing Model using Random Forest and Particle Swarm Optimization for Estimation of Undrained Shear Strength of Soil,” Sustainability, vol. 12, no. 6, pp. 1-16, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[39] Nitish Puri, Harsh Deep Prasad, and Ashwani Jain, “Prediction of Geotechnical Parameters using Machine Learning Techniques,” Procedia Computer Science, vol. 125, pp. 509-517, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[40] Vinicius Luiz Pacheco et al., “Cone Penetration Test Prediction Based on Random Forest Models and Deep Neural Networks,” Geotechnical and Geological Engineering, vol. 41, no. 8, pp. 4595-4628, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[41] Anna Veronika Dorogush, Vasily Ershov, and Andrey Gulin, “Catboost: Gradient Boosting with Categorical Features Support,” arXiv preprint, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[42] Liudmila Prokhorenkova et al., “Catboost: Unbiased Boosting with Categorical Features,” Advances in Neural Information Processing Systems, vol. 31, 2018. [Google Scholar] [Publisher Link]
[43] Mário Papík et al., “CatBoost: The Case of Bankruptcy Prediction,” International Conference on Business and Technology, pp. 3-17, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[44] B. Dhananjay, and J. Sivaraman, “Analysis and Classification of Heart Rate Using Catboost Feature Ranking Model,” Biomedical Signal Processing and Control, vol. 68, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[45] Abhisht Joshi et al., “CatBoost—An Ensemble Machine Learning Model for Prediction and Classification of Student Academic Performance,” Advances in Data Science and Adaptive Analysis, vol. 13, no. 3, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[46] Li Diao et al., “Short-Term Weather Forecast Based on Wavelet Denoising and Catboost,” Chinese Control Conference, pp. 3760-3764, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[47] Guomin Huang et al., “Evaluation of Catboost Method for Prediction of Reference Evapotranspiration in Humid Regions,” Journal of Hydrology, vol. 574, pp. 1029-1041, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[48] David H. Wolpert, “Stacked Generalization,” Neural Networks, vol. 5, no. 2, pp. 241-259, 1992.
[CrossRef] [Google Scholar] [Publisher Link]
[49] Shan Lin et al., “Comparative Performance of Eight Ensemble Learning Approaches for the Development of Models of Slope Stability Prediction,” Acta Geotechnica, vol. 17, no. 4, pp. 1477-1502, 2022.
[CrossRef] [Google Scholar] [Publisher Link]