A Novel Hybrid Approach to Machine Learning for Enhanced Model Precision and Classification

International Journal of Electrical and Electronics Engineering

© 2025 by SSRG - IJEEE Journal

Volume 12 Issue 2

Year of Publication : 2025

Authors : Bashir Mohamed Osman, Mohamed Sheikh Ali Jirow, Daud Ali Aser

10.14445/23488379/IJEEE-V12I2P111

How to Cite?

Bashir Mohamed Osman, Mohamed Sheikh Ali Jirow, Daud Ali Aser, "A Novel Hybrid Approach to Machine Learning for Enhanced Model Precision and Classification," SSRG International Journal of Electrical and Electronics Engineering, vol. 12,  no. 2, pp. 91-101, 2025. Crossref, https://doi.org/10.14445/23488379/IJEEE-V12I2P111

Abstract:

Integrating machine learning techniques with advanced algorithms like Random Forest and Support Vector Machines is the bedrock of enhancing predictive accuracy and model interpretability in a wide range of domains. This work will bridge the important gap in the complete application of these sophisticated techniques, especially in some strategically sensitive sectors like environmental management, healthcare, and industrial applications, which need highly adjusted predictions. In this regard, the aim is to propose, within this study, a hybrid interpretable and robust model that combines the strengths of RF and SVM to overcome common difficulties related to feature selection and classification. The strategy is to use the RF model for feature selection and preliminary classification and then use the Support Vector Machine for final classification-capable of RF in ranking features based on their importance and the precision of the Support Vector Machine for classification. Then, this hybrid model was further applied to complex datasets and gave results of superior performance measures, with accuracy, precision, recall, and F1 score close to 1.0 to prove the robustness of this model. Actually, the overall accuracy reached 99.89%, while precision and F1 both reached 99.93% for the hybrid model, which outperformed the standalone models significantly. The results indicate that the hybrid RF-SVM model has great potential for optimizing predictive models and decision-making processes, enhancing their performances in critical applications.

Keywords:

Machine Learning, Random Forest, Support Vector Machine, Hybrid model, Predictive accuracy.

References:

[1] Hoang Thi Hang et al., “Exploring Forest Fire Susceptibility and Management Strategies in Western Himalaya: Integrating Ensemble Machine Learning and Explainable AI for Accurate Prediction and Comprehensive Analysis,” Environmental Technology and Innovation, vol. 35, pp. 1-23, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Md. Ariful Islam et al., “Precision Healthcare: A Deep Dive into Machine Learning Algorithms and Feature Selection Strategies for Accurate Heart Disease Prediction,” Computers in Biology and Medicine, vol. 176, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Alif Elham Khan et al., “Predicting Life Satisfaction Using Machine Learning and Explainable AI,” Heliyon, vol. 10, no. 10, pp. 1-30, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Jiekee Lim et al., “Predicting TCM Patterns Jiekee Lim in PCOS Patients: An Exploration of Feature Selection Methods and Multi-Label Machine Learning Models,” Heliyon, vol. 10, no. 15, pp. 1-13, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Afreen Khan, and Swaleha Zubair, “Development of a Three Tiered Cognitive Hybrid Machine Learning Algorithm for Effective Diagnosis of Alzheimer’s Disease,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 10, pp. 8000-8018, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Jishan Ahmed, and Robert C. Green II, “Predicting Severely Imbalanced Data Disk Drive Failures with Machine Learning Models,” Machine Learning with Applications, vol. 9, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Pei-Yu Wu et al., “Predicting The Presence of Hazardous Materials in Buildings Using Machine Learning,” Building and Environment, vol. 213, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[8] El Arbi Abdellaoui Alaoui et al, “Towards to Intelligent Routing for DTN Protocols Using Machine Learning Techniques,” Simulation Modelling Practice and Theory, vol. 117, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Ahmad Abdulla, George Baryannis, and Ibrahim Badi “An Integrated Machine Learning and MARCOS Method for Supplier Evaluation and Selection,” Decision Analytics Journal, vol. 9, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Shakil Ahmed et al., “A Study on Road Accident Prediction and Contributing Factors using Explainable Machine Learning Models: Analysis and Performance,” Transportation Research Interdisciplinary Perspectives, vol. 19, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Amr E. Eldin Rashed, Ashraf M. Elmorsy, and Ahmed E. Mansour Atwa, “Comparative Evaluation of Automated Machine Learning Techniques for Breast Cancer Diagnosis,” Biomedical Signal Processing and Control, vol. 86, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Pantelis Z. Lappas, and Athanasios N. Yannacopoulos, “A Machine Learning Approach Combining Expert Knowledge with Genetic Algorithms in Feature Selection for Credit Risk Assessment,” Applied Soft Computing, vol. 107, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Iurii Konovalenko, and André Ludwig, “Comparison of Machine Learning Classifiers: A Case Study of Temperature Alarms in a Pharmaceutical Supply Chain,” Information Systems, vol. 100, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Spyridon D. Vrontos, John Galakis, and Ioannis D. Vrontos, “Modeling and Predicting U.S. Recessions Using Machine Learning Techniques,” International Journal of Forecasting, vol. 37, no. 2, pp. 647-671, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[15] F. Folino et al., “On Learning Effective Ensembles of Deep Neural Networks for Intrusion Detection,” Information Fusion, vol. 72, pp. 48-69, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Majdi Khalid et al., “A Dynamic Selection Hybrid Model for Advancing Thyroid Care with BOO-ST Balancing Method,” IEEE Access, vol. 12, pp. 78641-78656, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Qingqing Kong et al., “Classification Application Based on Mutual Information and Random Forest Method for High Dimensional Data,” 9th International Conference on Intelligent Human-Machine Systems and Cybernetics, Hangzhou, China, pp. 171-174, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Velery Virgina Putri Wibowo et al., “Comparison between Support Vector Machine and Random Forest for Hepatocellular Carcinoma (HCC) Classification,” International Conference on Decision Aid Sciences and Application, Sakheer, Bahrain, pp. 618-622, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Sara Alshakrani, Sawsan Hilal, and Ahmed M. Zeki, “Hybrid Machine Learning Algorithms for Polycystic Ovary Syndrome Detection,” International Conference on Data Analytics for Business and Industry, Sakhir, Bahrain, pp. 160-164, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Helia Farhood et al., “Evaluating and Enhancing Artificial Intelligence Models for Predicting Student Learning Outcomes,” Informatics, vol. 11, no. 3, pp. 1-17, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Yaping Chang, Wei Li, and Zhongming Yang, “Network Intrusion Detection Based on Random Forest and Support Vector Machine,” IEEE International Conference on Computational Science and Engineering and IEEE International Conference on Embedded and Ubiquitous Computing, Guangzhou, China, pp. 635-638, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Fang Hong, and Yingying Kong, “Random Forest Fusion Classification of Remote Sensing Polsar and Optical Image Based on Lasso and IM Factor,” IEEE International Geoscience and Remote Sensing Symposium, pp. 5048-5051, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Qi Mi et al., “Data for: Using Machine Learning to Predict Ovarian Cancer,” Mendeley Data, vol. 11, 2020.
[CrossRef] [Google Scholar] [Publisher Link]