Automatic Load Frequency Control for Wind-Thermal Micro Grid Based on Deep Reinforcement Learning

International Journal of Electrical and Electronics Engineering

© 2021 by SSRG - IJEEE Journal

Volume 8 Issue 8

Year of Publication : 2021

Authors : E. G. Swetala, P. Sujatha, P. Bharath

10.14445/23488379/IJEEE-V8I8P101

How to Cite?

E. G. Swetala, P. Sujatha, P. Bharath, "Automatic Load Frequency Control for Wind-Thermal Micro Grid Based on Deep Reinforcement Learning," SSRG International Journal of Electrical and Electronics Engineering, vol. 8,  no. 8, pp. 1-8, 2021. Crossref, https://doi.org/10.14445/23488379/IJEEE-V8I8P101

Abstract:

Renewable energy demand keeps increasing each day due its significances over the conventional sources of energy, particularly in this era where the world is faced with many challenges related to clean energy. Among Renewable Energy Resources (RERs), wind energy has proven to be cheaper and readily available. However, it is intermittent in nature and therefore affecting the voltage and frequency stability of microgrid systems, especially in occurrence of wind power ramping events. In this work, a simple Deep Reinforcement based Automatic Load Frequency Controller (DRL-ALFC) is designed so as to improve the frequency stability of an ALFC during wind power ramping events in a wind-thermal micro grid. A DRL-ALFC for wind-thermal microgrid is verified in MATLAB/Simulink environment where it shows the ability to adapt to the variations wind power fluctuation and load.

Keywords:

Automatic load frequency controller, Deep Reinforcement based Automatic Load Frequency Controller (DRL-ALFC), Renewable energy resources (RERs), Wind-Thermal microgrid.

References:

[1] Aldaouab, Ibrahim, and Malcolm Daniels, Microgrid Battery and Thermal Storage for Improved Renewable Penetration and Curtailment, IESC - International Energy and Sustainability Conference. 2017 (2017) 1–5.
[2] Annamraju, Anil, and Srikanth Nandiraju, Load Frequency Control of an Autonomous Microgrid Using Robust Fuzzy PI Controller. 8th International Conference on Power Systems: Transition towards Sustainable, Smart and Flexible Grids, ICPS 2019, IEEE. (2019) 1–6.
[3] Bugade, Vilas S, Optimal Power Flow Approach for Cognitive and Reliable Operation of Distributed Generation as Smart Grid. Smart Grid and Renewable Energy. 8(03) (2017) 87–98.
[4] Daneshfar F, and H. Bevrani, Load-Frequency Control: A GA-Based Multi-Agent Reinforcement Learning, IET Generation, Transmission and Distribution. 4(1) (2010) 13–26.
[5] Daneshfar, Fatemeh, Intelligent Load-Frequency Control in a Deregulated Environment: Continuous-Valued Input, Extended Classifier System Approach, IET Generation, Transmission and Distribution. 7(6) (2013) 551–559.
[6] Ding, Yongsheng, et al., Data-Driven Neuroendocrine Ultrashort Feedback-Based Cooperative Control System, IEEE Transactions on Control Systems Technology. 23(3) (2015) 1205–1212.
[7] Falahati, Saber, et al., Grid Secondary Frequency Control by Optimized Fuzzy Control of Electric Vehicles, IEEE Transactions on Smart Grid. 9(6) (2018) 5613–5621.
[8] Kermani, Homa Rashidizadeh, et al., Frequency Control of a Microgrid Including Renewable Resources with Energy Management of Electric Vehicles. 4th Iranian Conference on Renewable Energy and Distributed Generation, ICREDG 2016, IEEE. (2016) 114–118.
[9] Li, W. Y, and B. Bagen, Reliability Evaluation of Integrated Wind/Diesel/ Storage Systems for Remote Locations. IEEE 11th International Conference on Probabilistic Methods Applied to Power Systems, PMAPS 2010. (2010) 791–975.
[10] Liu, Hui, et al., Vehicle-to-Grid Control for Supplementary Frequency Regulation Considering Charging Demands. IEEE Transactions on Power Systems. 30(6) (2015) 3110–3119.
[11] Long, Dinh Tho, et al., Reseach on Solutions to Improve the Quality of Renewable Energy Electrical Power in the Micro Grids with FESS. International Journal of Electrical and Electronics Engineering. 7(10) (2020) 22–27.
[12] Morsali, Javad, et al., AGC of Interconnected Multi-Source Power System with Considering GDB and GRC Nonlinearity Effects. 6th Conference on Thermal Power Plants, CTPP 2016. (2016) 12–17.
[13] Ota, Yutaka, et al., Autonomous Distributed V2G (Vehicle-to-Grid) Satisfying Scheduled Charging. IEEE Transactions on Smart Grid. 3(1) (2012) 559–564.
[14] Shi, Xuewei, et al., Research on Energy Storage Configuration Method Based on Wind and Solar Volatility. 10th International Conference on Power and Energy Systems, ICPES 2020. (2020) 464–468.
[15] Singh, Samarth, and R. Mitra, Comparative Analysis of Robustness of Optimally Offline Tuned PID Controller and Fuzzy Supervised PID Controller. 2014 Recent Advances in Engineering and Computational Sciences, RAECS 2014, IEEE. (2014) 6–8.
[16] Singh, Vijay Pratap, et al., Distributed Multi-Agent System-Based Load Frequency Control for Multi-Area Power System in Smart Grid, IEEE Transactions on Industrial Electronics. 64(6) (2017) 51–60.
[17] Vachirasricirikul, Sitthidet, and Issarachai Ngamroo, Robust LFC in a Smart Grid with Wind Power Penetration by Coordinated V2G Control and Frequency Controller, IEEE Transactions on Smart Grid. 5(1) (2014) 371–380.
[18] Yan, Ziming, and Yan Xu. A Multi-Agent Deep Reinforcement Learning Method for Cooperative Load Frequency Control of a Multi-Area Power System. IEEE Transactions on Power Systems. 35(6) (2020) 4599–4608.
[19] Zhang Li. Data-Driven Load Frequency Control for Stochastic Power Systems: A Deep Reinforcement Learning Method with Continuous Action Search, IEEE Transactions on Power Systems. 34(2) (2019) 1653–1656.
[20] Yin, Linfei, et al., Artificial Emotional Reinforcement Learning for Automatic Generation Control of Large-Scale Interconnected Power Grids, IET Generation, Transmission and Distribution. 11(9) (2017) 2305–2313.
[21] Zhang, Dongying, et al., Research on AGC Performance during Wind Power Ramping Based on Deep Reinforcement Learning, IEEE Access. 8 (2020) 107409–107418.
[22] Zhang, Yang, et al., Optimized Scheduling Model for Isolated Microgrid of Wind-Photovoltaic-Thermal-Energy Storage System with Demand Response. IEEE Congress on Evolutionary Computation, CEC 2019 - Proceedings. (2019) 1170–1175.
[23] Zhao, Zhuoli, et al., Multiple-Time-Scales Hierarchical Frequency Stability Control Strategy of Medium-Voltage Isolated Microgrid, IEEE Transactions on Power Electronics. 31(8) (2016) 5974–5979.