Intelligent Voltage Control Method in Active Distribution Networks Based on Averaged Weighted Double Deep Q-network Algorithm

作     者：Yangyang Wang Meiqin Mao Liuchen Chang Nikos D.Hatziargyriou 

作者机构：Research Center for Photovoltaic System EngineeringMinistry of EducationSchool of Electrical Engineering and AutomationHefei University of TechnologyHefei 230009China University of New BrunswickFrederictonNB E3B 5A3Canada National Technical University of AthensAthens 15780Greece IEEE 

出 版 物：《Journal of Modern Power Systems and Clean Energy》 (现代电力系统与清洁能源学报（英文）)

年 卷 期：2023年第11卷第1期

页      面：132-143页

核心收录：

学科分类：0710[理学-生物学] 0808[工学-电气工程] 080802[工学-电力系统及其自动化] 08[工学] 0811[工学-控制科学与工程] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：supported in part by the Anhui Province Natural Science Foundation(No.2108085UD02) the National Natural Science Foundation of China(No.51577047) 111 Project(No.BP0719039)。 

主　　题：Averaged weighted double deep Q-network(AWDDQN) deep Q learning active distribution network(ADN) voltage control electrical vehicle(EV) 

摘      要：High penetration of distributed renewable energy sources and electric vehicles(EVs)makes future active distribution network(ADN)highly variable.These characteristics put great challenges to traditional voltage control methods.Voltage control based on the deep Q-network(DQN)algorithm offers a potential solution to this problem because it possesses humanlevel control performance.However,the traditional DQN methods may produce overestimation of action reward values,resulting in degradation of obtained solutions.In this paper,an intelligent voltage control method based on averaged weighted double deep Q-network(AWDDQN)algorithm is proposed to overcome the shortcomings of overestimation of action reward values in DQN algorithm and underestimation of action reward values in double deep Q-network(DDQN)algorithm.Using the proposed method,the voltage control objective is incorporated into the designed action reward values and normalized to form a Markov decision process(MDP)model which is solved by the AWDDQN algorithm.The designed AWDDQN-based intelligent voltage control agent is trained offline and used as online intelligent dynamic voltage regulator for the ADN.The proposed voltage control method is validated using the IEEE 33-bus and 123-bus systems containing renewable energy sources and EVs,and compared with the DQN and DDQN algorithms based methods,and traditional mixed-integer nonlinear program based methods.The simulation results show that the proposed method has better convergence and less voltage volatility than the other ones.