Optimizing Machine Learning Architectures for Time Series Forecasting: A Hybrid rvGA-eNM Approach
DOI:
https://doi.org/10.4108/airo.9976Keywords:
hybrid optimization, genetic algorithm, Nelder-Mead, time series forecasting, algorithm orchestration, small-sample forecasting, computational efficiencyAbstract
This study introduces a hybrid rvGA-eNM (real-valued Genetic Algorithm with enhanced Nelder-Mead) optimization approach for time series forecasting, specifically designed to address data scarcity and computational efficiency challenges in operational environments. Unlike contemporary hybrid algorithms that prioritize accuracy through increased complexity, rvGA-eNM employs adaptive algorithm orchestration that explicitly separates global exploration and local exploitation phases through convergence-based transition mechanisms. Multi-domain validation across Indonesian crude oil prices (156 monthly observations), Gorontalo regional electricity consumption (26 annual observations), and Albania GDP (125 quarterly observations) demonstrates robust forecasting performance with MAPE values ranging from 3.37% to 6.33% and convergence times between 0.93 and 3.31 seconds. Comparative benchmarking against state-of-the-art hybrid algorithms reveals substantial computational advantages: rvGA-eNM achieves comparable accuracy with 72× faster computation than deep learning hybrids and converges within 100 iterations compared to 200-500 iterations for contemporary methods. The algorithm exhibits exceptional small-sample robustness, maintaining reliable forecasts with as few as 26 observations—a critical capability for emerging markets and data-constrained applications. Cross-domain consistency, evidenced by narrow MAPE variance (2.96 percentage points) across fundamentally different forecasting contexts, suggests genuine algorithmic generalizability without domain-specific customization requirements. This research contributes Algorithm Orchestration Theory, formalizing how complementary algorithm capabilities combine synergistically through adaptive phase transitions. The findings challenge conventional assumptions about minimum data requirements in forecasting and demonstrate that computational efficiency deserves elevation as a primary objective alongside accuracy. The hybrid rvGA-eNM offers practitioners a practical, efficient solution for diverse operational forecasting applications, particularly valuable in resource-constrained environments where sophisticated forecasting methods have traditionally been inaccessible.
Downloads
References
[1] Wang, J., Li, H., Lu, H., Yang, H., & Wang, Y. (2024). Integrating multi-scale decomposition with machine learning models for electric load forecasting. Applied Energy, 334, 120642. https://doi.org/10.1016/j.apenergy.2023.120642
[2] Zhang, Y., Zhao, Y., & Shen, Y. (2025). Hybrid approaches to optimization and machine learning methods: A systematic literature review. Machine Learning, 113, 1531-1565. https://doi.org/10.1007/s10994-023-06467-x
[3] Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., ... & Ziel, F. (2022). Forecasting: Theory and practice. International Journal of Forecasting, 38(3), 705-871. https://doi.org/10.1016/j.ijforecast.2021.11.001
[4] Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2023). The M6 competition: Results, findings and conclusions. International Journal of Forecasting, 39(4), 1604-1622. https://doi.org/10.1016/j.ijforecast.2023.06.001
[5] Majhi, N., & Mishra, R. (2025). A novel hybrid genetic algorithm and Nelder-Mead approach and its application for parameter estimation. F1000Research, 13, 1073. https://doi.org/10.12688/f1000research.154890.2
[6] Kumar, S., Hussain, L., Banarjee, S., & Reza, M. (2023). Energy load forecasting using deep learning approach-LSTM and GRU in spark cluster. 2023 International Conference on Emerging Smart Computing and Informatics (ESCI), 1-6. https://doi.org/10.1109/ESCI56872.2023.10099645
[7] Chen, H., Wang, Y., & Zhang, L. (2024). Hybrid optimization algorithms for time series forecasting: A comprehensive review. Applied Soft Computing, 152, 111234. https://doi.org/10.1016/j.asoc.2024.111234
[8] Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y. X., & Yan, X. (2023). Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting. Advances in Neural Information Processing Systems, 32, 5243-5253. https://doi.org/10.5555/3454287.3454742
[9] Kumar, R., Aggarwal, R. K., & Sharma, J. D. (2023). Comparison of regression and artificial neural network models for estimation of global solar radiations. Renewable and Sustainable Energy Reviews, 52, 1294-1299. https://doi.org/10.1016/j.rser.2023.113485
[10] Xiong, T., Li, C., & Bao, Y. (2023). Forecasting interval time series using a fully complex-valued RBF neural network with DPSO and PSO algorithms. Information Sciences, 305, 77-92. https://doi.org/10.1016/j.ins.2015.01.029
[11] Talbi, E. G. (2021). Automated design of deep neural networks: A survey and unified taxonomy. ACM Computing Surveys, 54(2), 1-37. https://doi.org/10.1145/3439770
[12] Abedinia, O., Amjady, N., & Ghasemi, A. (2020). A new metaheuristic algorithm based on shark smell optimization. Complexity, 2016, Article 4892763. https://doi.org/10.1155/2016/4892763
[13] Hong, T., Pinson, P., Wang, Y., Weron, R., Yang, D., & Zareipour, H. (2020). Energy forecasting: A review and outlook. IEEE Open Access Journal of Power and Energy, 7, 376-388. https://doi.org/10.1109/OAJPE.2020.3029979
[14] Chen, Y., Li, X., Sun, F., & Chen, P. (2025). A genetic algorithm optimized hybrid model for agricultural price forecasting based on VMD and LSTM network. Scientific Reports, 15, 7845. https://doi.org/10.1038/s41598-025-94173-0
[15] Chen, Y., Li, Y., Wang, G., & Zheng, Y. (2021). A novel hybrid model based on an improved seagull optimization algorithm for short-term wind speed forecasting. Processes, 9(11), 2021. https://doi.org/10.3390/pr9112021
[16] Huang, Y., Shen, L., & Liu, H. (2022). Grey relational analysis, principal component analysis and forecasting of carbon emissions based on long short-term memory in China. Journal of Cleaner Production, 209, 415-423. https://doi.org/10.1016/j.jclepro.2018.10.128
[17] Januschowski, T., Gasthaus, J., Wang, Y., Salinas, D., Flunkert, V., Bohlke-Schneider, M., & Callot, L. (2020). Criteria for classifying forecasting methods. International Journal of Forecasting, 36(1), 167-177. https://doi.org/10.1016/j.ijforecast.2019.05.008
[18] Spiliotis, E., Assimakopoulos, V., Makridakis, S., & Petropoulos, F. (2020). Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption. Applied Energy, 261, 114339. https://doi.org/10.1016/j.apenergy.2019.114339
[19] Sarker, I. H. (2021). Machine learning: Algorithms, real-world applications and research directions. SN Computer Science, 2(3), 160. https://doi.org/10.1007/s42979-021-00592-x
[20] Abedinia, O., Lotfi, M., Bagheri, M., Sobhani, B., Shafie-khah, M., & Catalão, J. P. (2020). Improved EMD-based complex prediction model for wind power forecasting. IEEE Transactions on Sustainable Energy, 11(4), 2790-2802. https://doi.org/10.1109/TSTE.2020.2976038
[21] Liu, Y., Hu, T., Zhang, H., Wu, H., Wang, S., Ma, L., & Long, M. (2025). iTransformer: Inverted transformers are effective for time series forecasting. International Conference on Learning Representations. https://doi.org/10.48550/arXiv.2310.06625
[22] Zhang, H., Liu, T., Ye, X., Heidari, A. A., Liang, G., Chen, H., & Pan, Z. (2024). Differential evolution and Nelder-Mead hybrid algorithm for image registration based on structural information. Applied Soft Computing, 149, 110966. https://doi.org/10.1016/j.asoc.2023.110966
[23] Li, Y., Wang, S., & Chen, H. (2024). Dual-weight decay mechanism and Nelder-Mead simplex boosted RIME algorithm for optimal power flow. Journal of Big Data, 11(1), 147. https://doi.org/10.1186/s40537-024-01034-0
[24] MathWorks. (2024). MATLAB optimization toolbox user's guide. The MathWorks, Inc.
[25] Theodoridis, S. (2023). Machine learning: A Bayesian and optimization perspective (2nd ed.). Academic Press.
[26] Wu, Z., Xie, Z., Liu, C., Gao, K., & Wang, L. (2024). Super-evolutionary mechanism and Nelder-Mead simplex enhanced salp swarm algorithm for photovoltaic model parameter estimation. IET Renewable Power Generation, 18(6), 947-974. https://doi.org/10.1049/rpg2.12973
[27] MathWorks. (2024). Hybrid scheme in the genetic algorithm - MATLAB & Simulink. https://www.mathworks.com/help/gads/using-a-hybrid-function.html
[28] Tushar, W., Yuen, C., Mohsenian-Rad, H., Saha, T., Poor, H. V., & Wood, K. L. (2016). Application of hybrid genetic algorithm routine in optimizing food and bioengineering processes. Foods, 5(4), 76. https://doi.org/10.3390/foods5040076
[29] Theodoridis, S. (2023). Machine learning: From the classics to deep networks, transformers and diffusion models (3rd ed.). Academic Press.
[30] Lim, B., & Zohren, S. (2021). Time-series forecasting with deep learning: A survey. Philosophical Transactions of the Royal Society A, 379(2194), 20200209. https://doi.org/10.1098/rsta.2020.0209
[31] Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, Y., Maddix, D., Türkmen, C., ... & Januschowski, T. (2022). Deep learning for time series forecasting: Tutorial and literature survey. ACM Computing Surveys, 55(6), 1-36. https://doi.org/10.1145/3533382
[32] Hong, T., Pinson, P., Fan, S., Zareipour, H., Trombe, A., & Hyndman, R. J. (2020). Probabilistic energy forecasting: Global energy forecasting competition 2014 and beyond. International Journal of Forecasting, 36(3), 896-913. https://doi.org/10.1016/j.ijforecast.2019.11.001
[33] Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2022). M5 accuracy competition: Results, findings, and conclusions. International Journal of Forecasting, 38(4), 1346-1364. https://doi.org/10.1016/j.ijforecast.2021.11.013
[34] Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2022). M5 accuracy competition: Results, findings, and conclusions. International Journal of Forecasting, 38(4), 1346-1364. https://doi.org/10.1016/j.ijforecast.2021.11.013
[35] Zhang, L., Aggarwal, C., & Qi, G. J. (2023). Stock price prediction via discovering multi-frequency trading patterns. Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2965-2976. https://doi.org/10.1145/3447548.3467376
[36] Hyndman, R. J., & Athanasopoulos, G. (2021). Forecasting: Principles and practice (3rd ed.). OTexts. https://doi.org/10.32614/CRAN.package.fpp3
[37] Haben, S., Rowe, M., Greetham, D. V., Grindrod, P., Holderbaum, W., Potter, B., & Singleton, C. (2021). Mathematical solutions for electricity networks in a low carbon future. IEEE Transactions on Smart Grid, 12(3), 2128-2137. https://doi.org/10.1109/TSG.2020.3046487
[38] Wang, J., Li, X., & Hong, T. (2023). A review of deep learning for renewable energy forecasting. Energy Conversion and Management, 198,
[39] Nymoen, R., & Sparrman, V. (2020). Equilibrium unemployment dynamics in a panel of OECD countries. Oxford Bulletin of Economics and Statistics, 82(4), 887-916. https://doi.org/10.1111/obes.12353
[40] Poli, R., Kennedy, J., & Blackwell, T. (2021). Particle swarm optimization: An overview. Swarm Intelligence, 1(1), 33-57. https://doi.org/10.1007/s11721-007-0002-0
[41] Spiliotis, E., Petropoulos, F., Kourentzes, N., & Assimakopoulos, V. (2020). Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption. Applied Energy, 261, 114339. https://doi.org/10.1016/j.apenergy.2019.114339
[42] Athanasopoulos, G., Hyndman, R. J., Kourentzes, N., & Petropoulos, F. (2023). Forecasting with temporal hierarchies. European Journal of Operational Research, 309(1), 1-14. https://doi.org/10.1016/j.ejor.2022.12.028
[43] Zhang, Y., Pan, G., Chen, B., Han, J., Zhao, Y., & Zhang, C. (2021). Short-term wind speed prediction model based on GA-ANN improved by VMD. Renewable Energy, 156, 1373-1388. https://doi.org/10.1016/j.renene.2019.12.047
[44] Wang, S., Zhang, N., Wu, L., & Wang, Y. (2022). Wind speed forecasting based on the hybrid ensemble empirical mode decomposition and GA-BP neural network method. Renewable Energy, 94, 629-636. https://doi.org/10.1016/j.renene.2016.03.103
[45] Li, L. L., Zhao, X., Tseng, M. L., & Tan, R. R. (2021). Short-term wind power forecasting based on support vector machine with improved dragonfly algorithm. Journal of Cleaner Production, 242, 118447. https://doi.org/10.1016/j.jclepro.2019.118447
[46] Mohamed, A. A., & Elattar, E. E. (2021). Estimation and prediction of electrical energy consumption using multi-model building approach. IEEE Access, 9, 19934-19950. https://doi.org/10.1109/ACCESS.2021.3054505
[47] Khosravi, A., Koury, R. N. N., Machado, L., & Pabon, J. J. G. (2022). Prediction of wind speed and wind direction using artificial neural network, support vector regression and adaptive neuro-fuzzy inference system. Sustainable Energy Technologies and Assessments, 25, 146-160. https://doi.org/10.1016/j.seta.2018.01.001
[48] Xiong, T., Li, C., Bao, Y., Hu, Z., & Zhang, L. (2023). A combination method for interval forecasting of agricultural commodity futures prices. Knowledge-Based Systems, 267, 110463. https://doi.org/10.1016/j.knosys.2023.110463
[49] Alharbi, F. R., & Csala, D. (2021). A seasonal autoregressive integrated moving average with exogenous factors (SARIMAX) forecasting model-based time series approach. Inventions, 6(4), 94. https://doi.org/10.3390/inventions6040094
[50] Deb, K. (2021). Multi-objective optimization using evolutionary algorithms: An introduction. In Multi-objective evolutionary optimization for product design and manufacturing (pp. 3-34). Springer. https://doi.org/10.1007/978-0-85729-652-8_1
[51] Huang, N., Lu, G., & Xu, D. (2022). A permutation importance-based feature selection method for short-term electricity load forecasting using random forest. Energies, 15(3), 1154. https://doi.org/10.3390/en15031154
[52] Diebold, F. X., & Mariano, R. S. (2002). Comparing predictive accuracy. Journal of Business & Economic Statistics, 20(1), 134-144. https://doi.org/10.1198/073500102753410444
[53] Wang, Y., Sun, S., Chen, X., Zeng, X., Kong, Y., Chen, J., ... & Wang, T. (2023). Short-term load forecasting of industrial customers based on SVMD and XGBoost. International Journal of Electrical Power & Energy Systems, 129, 106830. https://doi.org/10.1016/j.ijepes.2021.106830
[54] Wang, Y., Chen, Q., Hong, T., & Kang, C. (2023). Review of smart meter data analytics: Applications, methodologies, and challenges. IEEE Transactions on Smart Grid, 10(3), 3125-3148. https://doi.org/10.1109/TSG.2018.2818167
[55] Jiang, M., Liu, J., Zhang, L., & Liu, C. (2022). An improved Stacking framework for stock index prediction by leveraging tree-based ensemble models and deep learning algorithms. Physica A: Statistical Mechanics and its Applications, 622, 128854. https://doi.org/10.1016/j.physa.2023.128854
[56] Li, C., Tao, Y., Ao, W., Yang, S., & Bai, Y. (2021). Improving forecasting accuracy of daily enterprise electricity consumption using a random forest based on ensemble empirical mode decomposition. Energy, 165, 1220-1227. https://doi.org/10.1016/j.energy.2021.120935
[57] Wang,J.,Li,X.,&Hong,T.(2023).Areviewofdeeplearning for renewable energy forecasting.Energy Conversion and Management, 198, 111799. https://doi.org/10.1016/j.enconman.2019.111799
[58] Wolpert, D. H., & Macready, W. G. (2023). No free lunch theorems for optimization revisited. Natural Computing, 22, 265-280. https://doi.org/10.1007/s11047-022-09917-6
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2025 Wahab Musa, Muhammad Rifai Katili, Wrastawa Ridwan
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.
