Intelligent Resource Provisioning and Optimization in Fog Computing using Deep Reinforcement Learning
| International Journal of Electronics and Communication Engineering |
| © 2023 by SSRG - IJECE Journal |
| Volume 10 Issue 8 |
| Year of Publication : 2023 |
| Authors : S. Aiswarya, Angelina Geetha, K. Ramesh |
10.14445/23488549/IJECE-V10I8P109
How to Cite?
S. Aiswarya, Angelina Geetha, K. Ramesh, "Intelligent Resource Provisioning and Optimization in Fog Computing using Deep Reinforcement Learning," SSRG International Journal of Electronics and Communication Engineering, vol. 10, no. 8, pp. 85-97, 2023. Crossref, https://doi.org/10.14445/23488549/IJECE-V10I8P109
Abstract:
The number of devices linked to the Internet is continuously rising along with the development of the Internet of Things (IoT). The IoT and the expanding volume of data it communicates place constraints on cloud-based data processing and storage. Both fog and cloud computing allow users to store apps and data, but Fog has a broader geographic reach and is closer to the end user. Managing rapidly changing resource provisioning and allocation of resources in fog computing will create new challenges when developing IoT applications and satisfying user requests. To control resource consumption and Service Level Agreements (SLA), flexible and often autonomous systems must choose the appropriate virtual resources. This work presents a Deep Reinforcement Learning (DRL) based structure for resource provisioning for improving resource management efficiency in IoT ecosystems. A Deep Neural Network (DNN) is used for assessing value functions, and it allows for better compliance to diverse conditions, learning from prior sensible approaches, and acting as a self-learning adaptive system. Using the DRL algorithm and the Proximal Policy Optimization (PPO), IoT services can be established by reducing average consumption of energy and latency, cutting expenses, and wisely utilising and allocating resources. Simulations with the iFogSim show that the PPO policy increases utilization, reduces delay rates, and maintains acceptable service quality while reducing energy consumption and increasing utilization under varying loading rates.
Keywords:
Deep learning, Energy utilization, Proximal policy optimization, Neural network, Resource provisioning, Reinforcement learning.
References:
[1] S. Aiswarya et al., “A Time Optimization Model for the Internet of Things-Based Healthcare System using Fog Computing,” 2021 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES), Chennai, India, pp. 1-6, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Kaouther Gasmi et al., “A Survey on Computation Offloading and Service Placement in Fog Computing-Based IoT,” The Journal of Supercomputing, vol. 78, no. 2, pp. 1983-2014, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[3] R. Surendiran, and K. Raja, “A Fog Computing Approach for Securing IoT Devices Data using DNA-ECC Cryptography,” DS Journal of Digital Science and Technology, vol. 1, no. 1, pp. 10-16, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Mostafa Ghobaei-Arani, Alireza Souri, and Ali A. Rahmanian, “Resource Management Approaches in Fog Computing: A Comprehensive Review,” Journal of Grid Computing, vol. 18, no. 1, pp. 1-42, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Sukhpal Singh, and Inderveer Chana, “Resource Provisioning and Scheduling in Clouds: QoS Perspective,” The Journal of Supercomputing, vol. 72, no. 3, pp. 926-960, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Soheil Hashemi, and Mani Zarei, “Internet of Things Backdoors: Resource Management Issues, Security Challenges, and Detection Methods,” Transaction on Emerging Telecommunications Technologies, vol. 32, no. 2, p. e4142, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[7] A. V. Dastjerdi et al., “Chapter 4 - Fog Computing: Principals, Architectures, and Applications,” Internet of Things, Principles and Paradigms, pp. 61-75, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[8] A. Lakshna et al., “Smart Navigation for Vehicles to Avoid Road Traffic Congestion using Weighted Adaptive Navigation* Search Algorithm,” SSRG International Journal of Electronics and Communication Engineering, vol. 10, no. 5, pp. 170-177, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Georgios L. Stavrinides, and Helen D. Karatza, “Orchestration of Real-Time Workflows with Varying Input Data Locality in a Heterogeneous Fog Environment,” 2020 Fifth International Conference on Fog and Mobile Edge Computing (FMEC), Paris, France, pp. 202-209, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Ranesh Kumar Naha et al., “Deadline-Based Dynamic Resource Allocation and Provisioning Algorithms in the Fog-Cloud Environment,” Future Generation Computer Systems, vol. 104, pp. 131-141, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Thinh Quang Dinh et al., “Online Resource Procurement and Allocation in a Hybrid Edge-Cloud Computing System,” IEEE Transactions on Wireless Communications, vol. 19, no. 3, pp. 2137-2149, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Hamid Reza Arkian, Abolfazl Diyanat, and Atefe Pourkhalili, “MIST: Fog-Based Data Analytics Scheme with Cost-Efficient Resource Provisioning for IoT Crowdsensing Applications,” Journal of Network and Computer Applications, vol. 82, pp. 152-165, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Tayebeh Bahreini, Hossein Badri, and Daniel Grosu, “Energy-Aware Capacity Provisioning and Resource Allocation in Edge Computing Systems,” International Conference on Edge Computing, Edge Computing – EDGE 2019, pp. 31-45, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Naman Madan et al., “On-Demand Resource Provisioning for Vehicular Networks using Flying Fog,” Vehicular Communications, vol. 25, p. 100252, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Muhammad Abdullah et al., “Predictive Autoscaling of Microservices Hosted in Fog Micro Data Centre,” IEEE Systems Journal, vol. 15, no. 1, pp. 1275-1286, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Ruchika, and Rajender Singh Chhillar, “Comparison of Meta-Heuristic Optimization Algorithms for Solving Optimized Task Scheduling Problems in Fog Environment,” International Journal of Engineering Trends and Technology, vol. 71, no. 3, pp. 175-183, 2023.
[CrossRef] [Publisher Link]
[17] Jingjing Guo et al., “On-Demand Resource Provision Based on Load Estimation and Service Expenditure in Edge Cloud Environment,” Journal of Network and Computer Applications, vol. 151, p. 102506, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Nazli Siasi et al., “Delay-Aware SFC Provisioning in Hybrid Fog-Cloud Computing Architectures,” IEEE Access, vol. 8, pp. 167383- 167396, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Chunlin Li, Jingpan Bai, and Youlong Luo, “Efficient Resource Scaling Based on Load Fluctuation in Edge-Cloud Computing Environment,” The Journal of Supercomputing, vol. 76, pp. 6994-7025, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Uma Tadakamalla, and Daniel A. Menascé, “Autonomic Resource Management using Analytic Models for Fog/Cloud Computing,” 2019 IEEE International Conference on Fog Computing (ICFC), Prague, Czech Republic, pp. 69-79, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Harikrishnan Natarajan, and P. Ajitha, “Truthful Bidding for Cloud Resources Based on Competitive Cloud Auction, Costing and Depreciation,” SSRG International Journal of Computer Science and Engineering, vol. 3, no. 3, pp. 9-12, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Mohammad Faraji Mehmandar, Sam Jabbehdari, and Hamid Haj Seyyed Javadi, “A Dynamic Fog Service Provisioning Approach for IoT Applications,” International Journal of Communication Systems, vol. 33, no. 14, p. e4541, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Mohammad Faraji-Mehmandar, Sam Jabbehdari, and Hamid Haj Seyyed Javadi, “A Proactive Fog Service Provisioning Framework for Internet of Things Applications: An Autonomic Approach,” Transaction on Emerging Telecommunications Technologies, vol. 32, no. 11, p. e44342, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Boyun Liu et al., “Workload Forecasting Based Elastic Resource Management in Edge Cloud,” Computers & Industrial Engineering, vol. 139, p. 106136, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[25] Nelli Chandrakala, and Vamsidhar Enireddy, “Provisioning of Defensing Mechanism against Threats during VM Migration in Cloud Environment,” International Journal of Engineering Trends and Technology, vol. 70, no. 6, pp. 1-12, 2022.
[CrossRef] [Publisher Link]
[26] Zafer Al-Makhadmeh, and Amr Tolba, “SRAF: Scalable Resource Allocation Framework using Machine Learning in User-Centric Internet of Things,” Peer-to-Peer Networking and Applications, vol. 14, no. 4, pp. 2340-2350, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Sukhpal Singh Gill, Peter Garraghan, and Rajkumar Buyya, “ROUTER: Fog Enabled Cloud-Based Intelligent Resource Management Approach for Smart Home IoT Devices,” Journal of Systems and Software, vol. 154, pp. 125-138, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[28] Ashkan Yousefpour et al., “FogPlan: A Lightweight Qos-Aware Dynamic Fog Service Provisioning Framework,” IEEE Internet of Things Journal, vol. 6, no. 3, pp. 5080-5096, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Aiswarya S et al., “Internet of Health Things: A Fog computing Paradigm,” 2022 6th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India, pp. 598-604, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[30] S. Aiswarya et al., “Latency Reduction in Medical IoT using Fuzzy Systems by Enabling Optimized Fog Computing,” SSRG International Journal of Electrical and Electronics Engineering, vol. 9, no. 12, pp. 156-166, 2022.
[CrossRef] [Publisher Link]
[31] Harshit Gupta et al., “iFogSim: A Toolkit for Modeling and Simulation of Resource Management Techniques in the Internet of Things, Edge and Fog Computing Environments,” Journal of Software: Practice and Experience, vol. 47, no. 9, pp. 1275-1296, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[32] Xiaoheng Deng et al., “Task Allocation Algorithm and Optimization Model on Edge Collaboration,” Journal of Systems Architecture, vol. 110, p. 101778, 2020.[CrossRef] [Google Scholar] [Publisher Link]