Deep Reinforcement Learning-Based Coordinated Voltage Control of HST and DG
DOI:
https://doi.org/10.4108/ew.14203Keywords:
distribution network voltage control, deep reinforcement learning, coordinated control, distributed generationAbstract
With the increasing penetration of distributed generation in active distribution networks, voltage fluctuation and voltage violation problems have become more prominent, especially in weak grids. Conventional voltage control methods based on empirical parameter tuning or single-device regulation often have limited adaptability under time-varying load conditions and fluctuating distributed generation output. To address these issues, this paper proposes a deep reinforcement learning based coordinated voltage control method for HST and DG. The proposed method takes monitored node voltages, load levels, and distributed generation outputs as state inputs and uses the gain adjustments of HST and DG as control actions, thereby achieving adaptive optimization of voltage response through a continuous decision-making framework. On this basis, an experimental validation framework including training and validation datasets, multi-strategy comparison communication-constrained analysis, and repeated-run statistics is established to evaluate the control performance generalization capability and robustness of the proposed method. The results show that the proposed strategy outperforms the baseline method in voltage deviation, overshoot oscillation energy, and control effort, while maintaining good performance consistency in the validation scenario. Under mild communication constraints, the proposed strategy still exhibits acceptable adaptability and operational stability. These findings indicate that deep reinforcement learning provides an effective optimization approach for coordinated HST and DG control and offers a useful reference for voltage regulation in active distribution networks.
Downloads
References
[1] Hua D, Peng F, Liu S, et al. Coordinated volt/var control in distribution networks considering demand response via safe deep reinforcement learning. Energies, 2025, 18(2): 333.
[2] Song G, Wu Q, Jiao W, et al. Distributed coordinated control for voltage regulation in active distribution networks based on robust model predictive control. International Journal of Electrical Power & Energy Systems, 2025, 166: 110529.
[3] Suchithra J, Rajabi A, Robinson D A. Enhancing PV hosting capacity of electricity distribution networks using deep reinforcement learning-based coordinated voltage control. Energies, 2024, 17(20): 5037.
[4] Zhang L, Yang F, Yan D, et al. Multi-agent deep reinforcement learning-based distributed voltage control of flexible distribution networks with soft open points. Energies, 2024, 17(21): 5244.
[5] Kabir F, Yu N P, Gao Y Q, et al. Deep reinforcement learning-based two-timescale Volt-VAR control with degradation-aware smart inverters in power distribution systems. Applied Energy, 2023, 335: 120629.
[6] Yang, T.; Liu, Y.; Li, H.; Chen, Y.; Pen, H. Cooperative Voltage Control in Distribution Networks Considering Multiple Uncertainties in Communication. Sustainable Energy, Grids and Networks, 2024, 39: 101459.
[7] Nematshahi, S.; Shi, D.; Wang, F.; Yan, B.; Nair, A. Deep Reinforcement Learning Based Voltage Control Revisited. IET Generation, Transmission & Distribution, 2023, 17(6).
[8] Murray W, Adonis M, Raji A. Voltage control in future electrical distribution networks. Renewable and Sustainable Energy Reviews, 2021, 146: 111100.
[9] Abdelkader S M, Kinga S, Ebinyu E, et al. Advancements in data-driven voltage control in active distribution networks: A Comprehensive review. Results in Engineering, 2024, 23: 102741.
[10] Wang J, Lan J, Wang L, et al. Voltage hierarchical control strategy for distribution networks based on regional autonomy and photovoltaic-storage coordination. Sustainability, 2024, 16(16): 6758.
[11] Yan Q, Chen X, Xing L, et al. Multi-Timescale Voltage Regulation for Distribution Network with High Photovoltaic Penetration via Coordinated Control of Multiple Devices. Energies, 2024, 17(15): 3830.
[12] Zhang T J, Yu L, Yue D, et al. Coordinated voltage regulation of high renewable-penetrated distribution networks: An evolutionary curriculum-based deep reinforcement learning approach. International Journal of Electrical Power & Energy Systems, 2023, 149: 108995.
[13] Ma, C.; Xiong, W.; Tang, Z.; Li, Z.; Xiong, Y.; Wang, Q. A Hierarchical Voltage Control Strategy for Distribution Networks Using Distributed Energy Storage. Electronics, 2025, 14(9): 1888.
[14] Xiong, W.; Tang, Z.; Cui, X. Distributed data-driven voltage control for active distribution networks with changing grid topologies. Control Engineering Practice, 2024, 147: 105933.
[15] Abbas, G.; Zhi, W.; Ali, A. A two-stage reactive power optimization method for distribution networks based on a hybrid model and data-driven approach. IET Renewable Power Generation, 2024, 18(16): 3967-3979.
[16] Li Z, Wu Q, Chen J, et al. Double-time-scale distributed voltage control for unbalanced distribution networks based on MPC and ADMM. International Journal of Electrical Power & Energy Systems, 2023, 145: 108665.
[17] Kabir F, Yu N P, Gao Y Q, Wang W Y. Deep reinforcement learning-based two-timescale Volt-VAR control with degradation-aware smart inverters in power distribution systems. Applied Energy, 2023, 335: 120629.
[18] Hossain, R.; Gautam, M.; Thapa, J.; Livani, H.; Benidris, M. Deep reinforcement learning assisted co-optimization of Volt-VAR grid service in distribution networks. Sustainable Energy, Grids and Networks, 2023, 35: 101086.
[19] Su, S.; Zhan, H.; Zhang, L.; Xie, Q.; Si, R.; Dai, Y.; Gao, T.; Wu, L.; Zhang, J.; Shang, L. Volt-VAR Control in Active Distribution Networks Using Multi-Agent Reinforcement Learning. Electronics, 2024, 13(10): 1971.
[20] Yan R D, Xing Q, Xu Y. Multi-agent safe graph reinforcement learning for PV inverters-based real-time decentralized Volt/VAR control in zoned distribution networks. IEEE Transactions on Smart Grid, 2024, 15(1): 299-311.
[21] Liu Q, Guo Y, Xu T. Robust deep reinforcement learning for inverter-based Volt-VAR control in partially observable distribution networks. Applied Energy, 2025, 399: 126445.
[22] Hossain, R.; Gautam, M.; Olowolaju, J.; Livani, H.; Benidris, M. Multi-agent voltage control in distribution systems using GAN-DRL-based approach. Electric Power Systems Research, 2024, 234: 110528.
[23] Wang L, Xie L, Yang Y, et al. Distributed online voltage control with fast PV power fluctuations and imperfect communication. IEEE Transactions on Smart Grid, 2023, 14(5): 3681-3695.
[24] Guo G D, Zhang M F, Gong Y F, Xu Q W. Safe multi-agent deep reinforcement learning for real-time decentralized control of inverter based renewable energy resources considering communication delay. Applied Energy, 2023, 349: 121648.
[25] Kang, W.; Guan, Y.; Wang, H.; Vasquez, J. C.; Agundis-Tinajero, G. D.; Guerrero, J. M. Distributed control of virtual energy storage systems for voltage regulation in low voltage distribution networks subjects to varying time delays. Applied Energy, 2024, 376: 124295.
[26] Zhang, F. Adaptive Event-Triggered Voltage Control of Distribution Network Subject to Actuator Attacks Using Neural Network-Based Sliding Mode Control Approach. Electronics, 2024, 13(15): 2960.
[27] Xiong, K.; et al. Multi-agent deep reinforcement learning-enabled voltage regulation approach for partitioned active distribution network using heterogeneous PV inverters. Energy Conversion and Economics, 2025, 6(6).
[28] Yu, P.; Zhang, H.; Song, Y.; Wang, Z.; Dong, H.; Ji, L. Safe reinforcement learning for power system control: A review. Renewable and Sustainable Energy Reviews, 2025, 223: 116022.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Hongliang Peng, Ruotian Yao, Riguang Huang, Shiqi Jiang, Xujun Wang

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open-access article distributed under the terms of the Creative Commons Attribution CC BY 4.0 license, which permits unlimited use, distribution, and reproduction in any medium so long as the original work is properly cited.