Measuring and Analyzing the Time Complexity of a Prediction Model in Different Scenarios

International Journal of Electronics and Communication Engineering

© 2024 by SSRG - IJECE Journal

Volume 11 Issue 12

Year of Publication : 2024

Authors : Rajan Saluja, Munishwar Rai

10.14445/23488549/IJECE-V11I12P108

How to Cite?

Rajan Saluja, Munishwar Rai, "Measuring and Analyzing the Time Complexity of a Prediction Model in Different Scenarios," SSRG International Journal of Electronics and Communication Engineering, vol. 11,  no. 12, pp. 83-91, 2024. Crossref, https://doi.org/10.14445/23488549/IJECE-V11I12P108

Abstract:

These days, almost every industry uses machine learning techniques. These techniques improve the accuracy of predicting the target output by using a wide range and velocity of data. The goal of each method is to quickly and accurately predict the target value. In this research, the execution time, which is the total time taken to predict the student’s grades, of the earlier proposed EMLRR model has been calculated. The model is based on an ensemble machine-learning technique: Stacking. Further, we have analyzed the time complexity of the model with other alternatives of stacking by choosing a variety of multiclassification models as meta-models. It has been observed that the proposed model has delivered an accuracy of up to 94% with an execution time of less than 3 seconds. This work uses various platforms, CPUs, and GPUs to analyze the execution time for two different datasets. Various student datasets have been tested to check the model’s efficiency in different scenarios. In addition, a comparative study has been done with other possible combinations of base models by increasing and decreasing the number of base models. The proposed prediction model uses the Stacking of four multiclass models to predict student performance with the best accuracy of up to 94% and 89% for two different student datasets.

Keywords:

Ensemble machine learning, Stacking, Multiclass models, Time complexity, Prediction.

References:

[1] Ammar Mohammed, and Rania Kora, “A Comprehensive Review on Ensemble Deep Learning: Opportunities and Challenges,” Journal of King Saud University - Computer and Information Sciences, vol. 35, no. 2, pp. 757-774, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Yuzhen Zhang, Jingjing Liu, and Wenjuan Shen, “A Review of Ensemble Learning Algorithms Used in Remote Sensing Applications,” Applied Sciences, vol. 12, no. 17, pp. 1-20, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[3] M.A. Ganaie et al., “Ensemble Deep Learning: A Review,” Engineering Applications of Artificial Intelligence, vol. 115, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Rajan Saluja, Munishwar Rai, and Rashmi Saluja, “Designing New Student Performance Prediction Model Using Ensemble Machine Learning,” Journal of Autonomous Intelligence, vol. 6, no. 1, pp. 1-12, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[5] D.P. Gaikwad, and Ravindra C. Thoo, “Intrusion Detection System Using Bagging Ensemble Method of Machine Learning,” 2015 International Conference on Computing Communication Control and Automation, Pune, India, pp. 291-295, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Jorge Martinez-Gil, “A Comprehensive Review of Stacking Methods for Semantic Similarity Measurement,” Machine Learning with Applications, vol. 10, pp. 1-12, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Mingshen Lu et al., “A Stacking Ensemble Model of Various Machine Learning Models for Daily Runoff Forecasting,” Water, vol. 15, no. 7, pp. 1-19, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Gajula Lakshmi Sahithi et al., “Credit Card Fraud Detection Using Ensemble Methods in Machine Learning,” 2022 6th International Conference on Trends in Electronics and Informatics, Tirunelveli, India, pp. 1237-1241, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Abdul Rehman Khalid et al., “Enhancing Credit Card Fraud Detection: An Ensemble Machine Learning Approach,” Big Data and Cognitive Computing, vol. 8, no. 1, pp. 1-27, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Jinyue Wang, and Chao Yang, “Financial Fraud Detection Based on Ensemble Machine Learning,” IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress, Falerna, Italy, pp. 1-6, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Shahid Mohammad Ganie, and Majid Bashir Malik, “An Ensemble Machine Learning Approach for Predicting Type-II Diabetes Mellitus Based on Lifestyle Indicators,” Healthcare Analytics, vol. 2, pp. 1-14, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Abebech Jenber Belay, Yelkal Mulualem Walle, and Melaku Bitew Haile, “Deep Ensemble Learning and Quantum Machine Learning Approach for Alzheimer’s Disease Detection,” Scientific Reports, vol. 14, pp. 1-10, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Mohammed S. Atoum et al., “A Fog-Enabled Framework for Ensemble Machine Learning-Based Real-Time Heart Patient Diagnosis,” International Journal of Engineering Trends and Technology, vol. 71, no. 8, pp. 39-47, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Tianfu Li, Jiaxing Shao, and Haoli Wang, “A Research of Spam Message Detection Based on Ensemble Learning,” Proceedings of the 4th International Conference on Artificial Intelligence and Computer Engineering, Dalian, China, pp. 507-512, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Abdallah Ghourabi, and Manar Alohaly, “Enhancing Spam Message Classification and Detection Using Transformer-Based Embedding and Ensemble Learning,” Sensors, vol. 23, no. 8, pp. 1-17, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Chensu Zhao et al., “A Heterogeneous Ensemble Learning Framework for Spam Detection in Social Networks with Imbalanced Data,” Applied Sciences, vol. 10, no. 3, pp. 1-18, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Kian Long Tan, Chin Poo Lee, and Kian Ming Lim, “Sentiment Analysis with Ensemble Hybrid Deep Learning Model,” IEEE Access, vol. 10, pp. 103694-103704, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Rania Kora, and Ammar Mohammed, “An Enhanced Approach for Sentiment Analysis Based on Meta-Ensemble Deep Learning,” Social Network Analysis and Mining, vol. 13, pp. 1-13, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Oscar Araque et al., “Enhancing Deep Learning Sentiment Analysis with Ensemble Techniques in Social Applications,” Expert Systems with Applications, vol. 77, pp. 236-246, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Satrio Adi Priyambada, Tsuyoshi Usagawa, and E.R. Mahendrawathi, “Two-Layer Ensemble Prediction of Students’ Performance Using Learning Behavior and Domain Knowledge,” Computers and Education: Artificial Intelligence, vol. 5, pp. 1-12, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Martin Stapel, Zhilin Zheng, and Niels Pinkwart, “An Ensemble Method to Predict Student Performance in an Online Math Learning Environment,” Proceedings of the 9th International Conference on Educational Data Mining, Raleigh, pp. 231-238, 2016.
[Google Scholar] [Publisher Link]
[22] Pooja Kumari, Praphula Kumar Jain, and Rajendra Pamula, “An Efficient Use of Ensemble Methods to Predict Students Academic Performance,” 2018 4th International Conference on Recent Advances in Information Technology, Dhanbad, India, pp. 1-6, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Randhir Singh, and Saurabh Pal, “Machine Learning Algorithms and Ensemble Technique to Improve Prediction of Students Performance,” International Journal of Advanced Trends in Computer Science and Engineering, vol. 9, no. 3, pp. 3970-3976, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Meimei Han et al., “Application of Ensemble Algorithm in Students' Performance Prediction,” 2017 6th IIAI International Congress on Advanced Applied Informatics, Hamamatsu, Japan, pp. 735-740, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[25] Kingsley Okoye et al., “Machine Learning Model (RG-DMML) and Ensemble Algorithm for Prediction of Students’ Retention and Graduation in Education,” Computers and Education: Artificial Intelligence, vol. 6, pp. 1-13, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[26] E. Fersini, E. Messina, and F.A. Pozzi, “Sentiment Analysis: Bayesian Ensemble Learning,” Decision Support Systems, vol. 68, pp. 26-28, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Stephen Afrifa et al., “Ensemble Machine Learning Techniques for Accurate and Efficient Detection of Botnet Attacks in Connected Computers,” Engineer, vol. 4, no. 1, pp. 1-15, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[28] Muhammad Fazal Ijaz et al., “Hybrid Prediction Model for Type 2 Diabetes and Hypertension Using DBSCAN-Based Outlier Detection, Synthetic Minority Over Sampling Technique (SMOTE), and Random Forest,” Applied Sciences, vol. 8, no. 8, pp. 1-22, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Abdiansah Abdiansah, and Retantyo Wardoyo, “Time Complexity Analysis of Support Vector Machines (SVM) in LibSVM,” International Journal of Computer Applications, vol. 128, no. 3, pp. 28-34, 2015.
[CrossRef] [Google Scholar] [Publisher Link]