Big Data and Machine Learning Framework for Temperature Forecasting

Authors

  • A Mekala Sacred Heart College image/svg+xml
  • Bhaskar Kamal Baishya Gologhat
  • Kamarajugadda Tulasi Vigneswara Rao Nicmar University
  • Deepak A Vidhate Dr Vithalrao Vikhe Patil College of Engineering
  • Vinayak A Drave O. P. Jindal Global University image/svg+xml
  • P Vishnu Prasanth Mohan Babu University

DOI:

https://doi.org/10.4108/ew.4195

Keywords:

Temperature Forecasting, Artificial Neural Network, Accuracy

Abstract

This research aims to develop a Supporting Big Data and ML with a Framework for temperature forecasting using Artificial Neural Networks (ANN). The proposed framework utilizes a massive amount of historical weather data to train the ANN model, which can effectively learn the complex non- correlations that are linear with the parameters and temperature. The input variables include various weather parameters, such as humidity, wind speed, precipitation, and pressure. The framework involves three main stages: data pre-processing, model training, and temperature forecasting. In the data pre-processing stage, the raw weather data is cleaned, normalized, and transformed into a suitable format for model training. The data is then split into training, validation, and testing sets to ensure model accuracy. In model instruction stage, the ANN trained model using a backpropagation algorithm to adjust affected by the inherent biases and model based on the input and output data. The training process is iterative, and Using the validation, the efficiency of the model is measured. set to prevent overfitting. Finally, in the temperature forecasting stage, the trained ANN model is used to predict the temperature for a given set of weather parameters. The accuracy of the temperature forecasting is evaluated using the testing set, and the results are compared to other forecasting methods, such as statistical methods and numerical weather prediction models. The proposed framework has several advantages over traditional temperature forecasting methods. Firstly, it utilizes a vast amount of data, which enhances the accuracy of the forecast. Secondly, the ANN model can learn the interactions between the input variables that are not linear and temperature, which cannot be captured by traditional statistical methods. Finally, the framework can be easily extended to incorporate additional weather parameters or to forecast other environmental variables. The results of this research show that the proposed framework can effectively forecast temperature with high accuracy, outperforming traditional statistical methods and numerical weather prediction models. Therefore, it has the potential to improve weather forecasting and contribute to various applications, such as agriculture, energy management, and transportation.

Downloads

Download data is not yet available.

References

Refonaa, J. and M. Lakshmi. “Remote sensing based rain fall prediction using big data assisted integrated routing framework.” Journal of Ambient Intelligence and Humanized Computing (2021): 1-11. DOI: https://doi.org/10.1007/s12652-020-02726-0

Pintye, Istvan et al. “Big data and machine learning framework for clouds and its usage for text classification.” Concurrency and Computation: Practice and Experience 33 (2020): n. pag. DOI: https://doi.org/10.1002/cpe.6164

Dogaru, Delia Ioana and Ioan Dumitrache. “Big Data and Machine Learning Framework in Healthcare.” 2019 E-Health and Bioengineering Conference (EHB) (2019): 1-4. DOI: https://doi.org/10.1109/EHB47216.2019.8969944

Sharma, Naresh and Rohit Sharma. “Real-time monitoring of physicochemical parameters in water using big data and smart IoT sensors.” Environment, Development and Sustainability (2022): 1 - 48. DOI: https://doi.org/10.1007/s10668-022-02142-8

Namitha, K. et al. “Rainfall Prediction using Artificial Neural Network on Map-Reduce Framework.” International Symposium on Women in Computing and Informatics (2015). DOI: https://doi.org/10.1145/2791405.2791468

Babu, S.B.G.T., Rao, C.S. Efficient detection of copy-move forgery using polar complex exponential transform and gradient direction pattern. Multimed Tools Appl 82, 10061–10075 (2023). https://doi.org/10.1007/s11042-022-12311-6 DOI: https://doi.org/10.1007/s11042-022-12311-6

Stefan Rahmstorf and Dim Coumou. Increase of extreme events in a warming world. Proceedings of the National Academy of Sciences, October 2011. ISSN 0027-8424, 1091- 6490. doi: 10.1073/pnas.1101766108. URL https://www.pnas.org/content/early/2011/ 10/18/1101766108.

Cleveland Abbe. The physical basis of long-range weather forecasts. Monthly Weather Review, 29(12):551–561, December 1901. ISSN 0027-0644. DOI: https://doi.org/10.1175/1520-0493(1901)29[551c:TPBOLW]2.0.CO;2

Vilhelm Bjerknes. Das Problem der Wettervorhers-age, betrachtet vom Standpunkte der Mechanik und der Physik. Meteor. Z., 21:1–7, 1904.

Lewis Fry Richardson. Weather Prediction by Numerical Process. Cambridge University Press, 1922. ISBN 978-0-521-68044-8.

Peter Bauer, Alan Thorpe, and Gilbert Brunet. The quiet revolution of numerical weather prediction. Nature, 525(7567):47–55, September 2015. ISSN 0028-0836, 1476-4687. doi: 10.1038/nature14956. URLmhttp://www.nature.com/doifinder/10.1038/nature14956. DOI: https://doi.org/10.1038/nature14956

T. Economou, D. B. Stephenson, J. C. Rougier, R. A. Neal, and K. R. Mylne. On the use of Bayesian decision theory for issuing natural hazard warnings. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 472(2194):20160295, October 2016. doi: 10.1098/rspa.2016.0295. URL https://royalsocietypublishing.org/doi/10. 1098/rspa.2016.0295. DOI: https://doi.org/10.1098/rspa.2016.0295

Michael Simpson, Rachel James, Jim W. Hall, et al. Decision Analysis for Management of Natural Hazards. Annual Review of Environment and Resources, 41(1):489–516, October 2016. ISSN 1543-5938. doi: 10.1146/annurev-environ-110615-090011. URL https://www. annualreviews.org/doi/10.1146/annurev-environ-110615-090011. DOI: https://doi.org/10.1146/annurev-environ-110615-090011

Varun Gulshan, Lily Peng, Marc Coram, et al. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA, 316(22):2402–2410, December 2016. ISSN 0098-7484. doi: 10.1001/jama.2016.17216. URL https://jamanetwork.com/journals/jama/fullarticle/2588763. DOI: https://doi.org/10.1001/jama.2016.17216

David Silver, Julian Schrittwieser, Karen Simonyan, et al. Mastering the game of Go without human knowledge. Nature, 550(7676):354–359, October 2017. ISSN 1476-4687. doi: 15.1038/nature24270. URL https://www.nature.com/articles/nature24270%3E. 10 Tony Hey, Keith Butler, Sam Jackson, and Jeyarajan Thiyagalingam. Machine learning and big scientific data. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 378(2166):20190054, March 2020. doi: 10.1098/rsta.2019.0054. URL https://royalsocietypublishing.org/doi/10.1098/rsta.2019.0054.

Babu, SBG Tilak, V. Satyanarayana, and Ch Srinivasarao. "Shift invarient and Eigen feature based image fusion." International Journal on Cybernetics & Informatics (IJCI) 5.4 (2016). DOI: https://doi.org/10.5121/ijci.2016.5418

Downloads

Published

20-10-2023

How to Cite

1.
Mekala A, Baishya BK, Vigneswara Rao KT, Vidhate DA, Drave VA, Prasanth PV. Big Data and Machine Learning Framework for Temperature Forecasting. EAI Endorsed Trans Energy Web [Internet]. 2023 Oct. 20 [cited 2024 May 17];10. Available from: https://publications.eai.eu/index.php/ew/article/view/4195