Big Data-Driven Short-Term Load Forecasting in Smart Grids: A Spatio-Temporal Dynamic Graph Transformer with Uncertainty-Aware Attention
DOI:
https://doi.org/10.4108/ew.13839Keywords:
short-term load forecasting, smart grid, dynamic graph neural network, Transformer, uncertainty quantification, deep learning, spatio-temporal data miningAbstract
Short-term load forecasting for modern smart grids must jointly model long-range temporal patterns, correlations across many metering points, and the uncertainty required for operational decision-making. We propose ST-DGT-UA, a spatio-temporal dynamic graph Transformer that (i) embeds heterogeneous covariates with convolutional projections and Time2Vec, (ii) learns a time-varying adjacency matrix from node representations, (iii) couples spatial graph attention with temporal ProbSparse attention for efficient long-sequence modeling, and (iv) outputs multiple conditional quantiles trained with multi-quantile Pinball loss. Experiments on GEFCom2014 and the UCI Electricity Load Diagrams datasets show that ST-DGT-UA achieves MAPE/RMSE of 1.92/145.6 on GEFCom2014 and 2.65/42.3 on UCI, and improves probabilistic quality with Pinball Loss 0.024 and CRPS 0.043. These results indicate that learning dynamic, data-driven
spatial dependencies is beneficial for multi-node load forecasting where correlations evolve over time.
Downloads
References
[1] T. Cao, Y. Xu, G. Liu, S. Tao, W. Tang, and H. Sun, “Feature-enhanced deep learning method for electric vehicle charging demand probabilistic forecasting of charging station,” Appl. Energy, vol.371, 123751, 2024.
[2] Y. Eren and I. Kucukdemiral, “A comprehensive review on deep learning approaches for short-term load forecasting,” Renewable Sustainable Energy Rev., vol.189, 114031, 2024.
[3] W. Kong, Z.Y. Dong, Y. Jia, D.J. Hill, Y. Xu, and Y. Zhang, “Short-term residential load forecasting based on LSTM recurrent neural network,” IEEE Trans. Smart Grid, vol.10, no.1, pp.841–851, 2019.
[4] K. Chen, K. Chen, Q. Wang, Z. He, J. Hu, and J. He, “Short-term load forecasting with deep residual networks,” IEEE Trans. Smart Grid, vol.10, no.4, pp.3943–3952, 2019.
[5] Y. Liu, T. Hu, H. Zhang, H. Wu, S. Wang, L. Ma, and M. Long, “iTransformer: Inverted Transformers are effective for time series forecasting,” Proc. Int. Conf. Learning Representations, 2024.
[6] H. Jiang and W. Zheng, “Deep learning with regularized robust long- and short-term memory network for probabilistic short-term load forecasting,” J. Forecasting, vol.41, no.6, pp.1201–1216, 2022.
[7] S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput., vol.9, no.8, pp.1735–1780, 1997.
[8] J. Wang, K. Wang, Z. Li, H. Lu, H. Jiang, and Q. Xing, “A multitask integrated deep-learning probabilistic prediction for load forecasting,” IEEE Trans. Power Syst., vol.39, no.1, pp.1240–1250, 2024.
[9] W.L. Hamilton, R. Ying, and J. Leskovec, “Inductive rep-resentation learning on large graphs,” Proc. Advances in Neural Information Processing Systems, vol.30, pp.1024–1034, 2017.
[10] Y. Wang, L. Rui, J. Ma, and Q. Jin, “A short-term residential load forecasting scheme based on the multiple correlation-temporal graph neural networks,” Appl. Soft Comput., vol.146, 110629, 2023.
[11] C. Wei, D. Pi, M. Ping, and H. Zhang, “Short-term load forecasting using spatial-temporal embedding graph neural network,” Electric Power Systems Research, vol.225, 109873, 2023.
[12] L. Chen, D. Chen, Z. Shang, B. Wu, C. Zheng, B. Wen, and W. Zhang, “Multi-scale adaptive graph neural network for multivariate time series forecasting,” IEEE Trans. Knowl. Data Eng., vol.35, no.10, pp.10748–10761, 2023.
[13] G. Jin, Y. Liang, Z. Fang, Z. Shao, J. Huang, J. Zhang, and Y. Zheng, “Spatio-temporal graph neural networks for predictive learning in urban computing: A survey,” IEEE Trans. Knowl. Data Eng., vol.36, no.10, pp.5388–5408, 2024.
[14] J. Liu, S. Dong, P. Zhang, T. Li, C. Peng, and Z. Hu, “Load forecasting based on dynamic adaptive and adversarial graph convolutional networks,” Energy Build., vol.312, 114206, 2024.
[15] H. Jiang, Y. Dong, Y. Dong, and J. Wang, “Power load forecasting based on spatial–temporal fusion graph convolution network,” Technological Forecasting and Social Change, vol.204, 123435, 2024.
[16] Y. Lv, L. Wang, D. Long, Q. Hu, and Z. Hu, “Multi-area short-term load forecasting based on spatiotemporal graph neural network,” Engineering Applications of Artificial Intelligence, vol.138, 109398, 2024.
[17] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” Proc. Advances in Neural Information Processing Systems, vol.30, pp.5998–6008, 2017.
[18] H. Wu, T. Hu, Y. Liu, H. Zhou, J. Wang, and M. Long, “TimesNet: Temporal 2D-variation modeling for general time series analysis,” Proc. Int. Conf. Learning Representations, 2023.
[19] Y. Nie, N.H. Nguyen, P. Sinthong, and J. Kalagnanam, “A time series is worth 64 words: Long-term forecasting with Transformers,” Proc. Int. Conf. Learning Representa-tions, 2023.
[20] T. Zhou, Z. Ma, Q. Wen, X. Wang, L. Sun, and R. Jin, “FEDformer: Frequency enhanced decomposed Transformer for long-term series forecasting,” Proc. Int. Conf. Machine Learning, vol.162, pp.27268–27286, 2022.
[21] J.W. Chan and C.K. Yeo, “A Transformer based approach to electricity load forecasting,” The Electricity Journal, vol.37, no.2, 107370, 2024.
[22] H. Jiang, S. Pan, Y. Dong, and J. Wang, “Probabilistic electricity price forecasting based on penalized temporal fusion transformer,” J. Forecasting, vol.43, no.5, pp.1465–1491, 2024.
[23] B. Wang, M. Mazhari, and C.Y. Chung, “A novel hybrid method for short-term probabilistic load forecasting in distribution networks,” IEEE Trans. Smart Grid, vol.13, no.5, pp.3650–3661, 2022.
[24] J. Gawlikowski, C.R.N. Tassi, M. Ali, J. Lee, M. Humt, J. Feng, A. Kruspe, R. Triebel, P. Jung, R. Roscher, M. Shahzad, W. Yang, R. Bamler, and X.X. Zhu, “A survey of uncertainty in deep neural networks,” Artif. Intell. Rev., vol.56, pp.1513–1589, 2023.
[25] X. Tang, H. Chen, W. Xiang, J. Yang, and M. Zou, “Short-term load forecasting using channel and temporal atten-tion based temporal convolutional network,” Electric Power Systems Research, vol.205, 107761, 2022.
[26] Q. Wen, T. Zhou, C. Zhang, W. Chen, Z. Ma, J. Yan, and L. Sun, “Transformers in time series: A survey,” Proc. Int. Joint Conf. Artificial Intelligence, pp.6778–6786, 2023.
[27] T. Hong, P. Pinson, S. Fan, H. Zareipour, A. Troccoli, and R.J. Hyndman, “Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond,” Int. J. Forecasting, vol.32, no.3, pp.896–913, 2016.
[28] A. Trindade, “ElectricityLoadDiagrams20112014 Dataset,” UCI Machine Learning Repository, 2015.
[29] B.N. Oreshkin, D. Carpov, N. Chapados, and Y. Bengio, “N-BEATS: Neural basis expansion analysis for interpretable time series forecasting,” Proc. Int. Conf. Learning Representations, 2020.
[30] T.N. Kipf and M. Welling, “Semi-supervised classifica-tion with graph convolutional networks,” Proc. Int. Conf. Learning Representations, 2017.
[31] T. Gneiting and A.E. Raftery, “Strictly proper scoring rules, prediction, and estimation,” J. Am. Stat. Assoc., vol.102, no.477, pp.359–378, 2007.
[32] F.X. Diebold and R.S. Mariano, “Comparing predictive accuracy,” J. Bus. Econ. Stat., vol.13, no.3, pp.253–263, 1995.
[33] D. Salinas, V. Flunkert, J. Gasthaus, and T. Januschowski, “DeepAR: Probabilistic forecasting with autoregressive recurrent networks,” Int. J. Forecasting, vol.36, no.3, pp.1181–1191, 2020.
[34] K. Li, Z. Li, C. Huang, and Q. Ai, “Online transfer learning-based residential demand response potential forecasting for load aggregator,” Appl. Energy, vol.358, 122631, 2024.
[35] Z. Chen, J. Li, L. Cheng, and X. Liu, “Federated-WDCGAN: A federated smart meter data sharing framework for privacy preservation,” Appl. Energy, vol.334, 120711, 2023.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Jing Zhou, Jiyue Long, Xiaohong Long
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open-access article distributed under the terms of the Creative Commons Attribution CC BY 4.0 license, which permits unlimited use, distribution, and reproduction in any medium so long as the original work is properly cited.
