A Privacy-Preserving Decentralized Partition-Autonomous Planning Method for Interconnected Multi-Microgrid Distribution Systems Driven by Federated Proximal Policy Optimization
DOI:
https://doi.org/10.4108/ew.14639Keywords:
Federated Learning, Proximal Policy Optimization, Differential Privacy, Multi-Substation Distribution System, Privacy-Preserving Decentralized PlanningAbstract
INTRODUCTION: The rapid integration of distributed renewable energy and ICT infrastructure has made interconnected multi-microgrid distribution systems essential for low-carbon power grids, yet centralized coordination exposes sensitive operational data to privacy risks, including eavesdropping and membership inference attacks under 5G and edge computing environments.
OBJECTIVES: This study resolves the tension between data privacy protection and decentralized collaborative planning by developing a unified federated reinforcement learning framework with formal privacy guarantees.
METHODS: A privacy-preserving decentralized partition-autonomous planning method driven by federated proximal policy optimization is proposed. The network is divided into autonomous units, each performing local proximal policy optimization on local observations. A proximal term constrains update steps against Non-IID drift. A time-period adaptive differential privacy budget mechanism dynamically adjusts noise according to gradient sensitivity, complemented by a Shamir secret sharing-based secure aggregation protocol forming dual-layer protection.
RESULTS: Experiments on the Baran-Wu 33-node test system show daily operational cost within 3.0% of the centralized benchmark, per round communication reduced by approximately 80% to 9.6 MB, voltage compliance at 98.4%, and membership inference attack AUC suppressed to 0.521
DISCUSSION: The adaptive privacy budget reduces utility loss by 3.2 percentage points under strict privacy constraints versus fixed schemes, while secure aggregation maintains reliability under one PAU dropout with only 0.38% deviation.
CONCLUSION: The proposed framework provides a feasible technical path for secure collaborative planning of large-scale interconnected multi-microgrid systems under practical ICT constraints.
Downloads
References
[1] Joshi A, et al. Survey on AI and machine learning techniques for microgrid energy management systems. IEEE/CAA J Autom Sin. 2023;10(7):1513-1529.
[2] Zhao J, et al. Deep reinforcement learning-based model-free on-line dynamic multi-microgrid formation to enhance resilience. IEEE Trans Smart Grid. 2022;13(4):2557-2567.
[3] Liu G, et al. Distributed energy management for networked microgrids embedded modern distribution system using ADMM algorithm. IEEE Access. 2023;11:102589-102604.
[4] Liu G, et al. Microgrid optimal scheduling with chance-constrained islanding capability. Electr Power Syst Res. 2017;145:197-206.
[5] Lee S, Choi DH. Federated reinforcement learning for energy management of multiple smart homes with distributed energy resources. IEEE Trans Ind Inform. 2020;18(1):488-497.
[6] Mukherjee S, et al. Resilient control of networked microgrids using vertical federated reinforcement learning: designs and real-time test-bed validations. IEEE Trans Smart Grid. 2024;16(2):1897-1910.
[7] Cao D, et al. Deep reinforcement learning based approach for optimal power flow of distribution networks embedded with renewable energy and storage devices. J Mod Power Syst Clean Energy. 2021;9(5):1101-1110.
[8] Guo C, et al. Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning. Energy. 2022;238:121873.
[9] Ye Y, et al. A scalable privacy-preserving multi-agent deep reinforcement learning approach for large-scale peer-to-peer transactive energy trading. IEEE Trans Smart Grid. 2021;12(6):5185-5200.
[10] 1She B, et al. Fusion of model-free reinforcement learning with microgrid control: review and vision. arXiv preprint arXiv:2206.11398. 2022.
[11] Baran ME, Wu FF. Network reconfiguration in distribution systems for loss reduction and load balancing. IEEE Trans Power Deliv. 1989;4(2):1401-1407.
[12] Zimmerman RD, Murillo-Sánchez CE, Thomas RJ. MATPOWER: steady-state operations, planning, and analysis tools for power systems research and education. IEEE Trans Power Syst. 2010;26(1):12-19.
[13] Wilson E, et al. End-use load profiles for the US building stock. Golden (CO): National Renewable Energy Laboratory; 2021. ….
[14] Liu H, Wu W. Federated reinforcement learning for decentralized voltage control in distribution networks. IEEE Trans Smart Grid. 2022;13(5):3840-3843.
[15] Chen X, et al. Reinforcement learning for selective key applications in power systems: recent advances and future challenges. IEEE Trans Smart Grid. 2022;13(4):2935-2958.
[16] Hu D, et al. Multi-agent deep reinforcement learning for voltage control with coordinated active and reactive power optimization. IEEE Trans Smart Grid. 2022;13(6):4873-4886.
[17] Zhou X, et al. Accelerated voltage regulation in multi-phase distribution networks based on hierarchical distributed algorithm. IEEE Trans Power Syst. 2019;35(3):2047-2058.
[18] Li T, et al. Federated learning: challenges, methods, and future directions. IEEE Signal Process Mag. 2020;37(3):50-60.
[19] Abadi M, et al. Deep learning with differential privacy. In: Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security; 2016.
[20] Bonawitz K, et al. Practical secure aggregation for privacy-preserving machine learning. In: Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security; 2017.
[21] Wei K, et al. Federated learning with differential privacy: algorithms and performance analysis. IEEE Trans Inf Forensics Secur. 2020;15:3454-3469.
[22] Mironov I. Rényi differential privacy. In: 2017 IEEE 30th Computer Security Foundations Symposium (CSF). IEEE; 2017.
[23] Bai L, et al. Membership inference attacks and defenses in federated learning: a survey. ACM Comput Surv. 2024;57(4):1-35.
[24] Shokri R, et al. Membership inference attacks against machine learning models. In: 2017 IEEE Symposium on Security and Privacy (SP). IEEE; 2017.
[25] Li T, et al. Federated optimization in heterogeneous networks. Proc Mach Learn Syst. 2020;2:429-450.
[26] Yin X, Zhu Y, Hu J. A comprehensive survey of privacy-preserving federated learning: a taxonomy, review, and future directions. ACM Comput Surv. 2021;54(6):1-36.
[27] Badr MM, et al. Privacy-preserving and communication-efficient energy prediction scheme based on federated learning for smart grids. IEEE Internet Things J. 2023;10(9):7719-7736.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Yao Duan, Ran Cheng, Chong Gao
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open-access article distributed under the terms of the Creative Commons Attribution CC BY 4.0 license, which permits unlimited use, distribution, and reproduction in any medium so long as the original work is properly cited.
