بهینه سازی شبکه عصبی کانولوشن با الگوریتم حشره آبسوار در پیش بینی وضعیت آب و هوایی

نوع مقاله : مقاله پژوهشی

نویسندگان

1 دانشجوی دکتری، دانشگاه آزاد اسلامی واحد فردوس، فردوس

2 استادیار، دانشگاه آزاد اسلامی واحد بیرجند، گروه کامپیوتر، بیرجند

3 دانشجوی دکتری، دانشگاه آزاد اسلامی واحد بیرجند، بیرجند

چکیده

یکی از موضوعات مهم و کاربردی در دنیای امروز، پیش بینی وضعیت آب و هوایی است. پیش بینی وضعیت آب و هوایی باعث می‌شود تا زیان و خسارات شرایط بحرانی آب و هوایی کاهش داده شود. پیش بینی وضعیت آب و هوایی می‌تواند در کاربردهای مانند کشاورزی و حمل و نقل هوایی موثر باشد. برای پیش بینی وضعیت آب و هوایی نیاز است که اطلاعات محیطی برای یک دوره مشخص گردآوری شود و سپس این اطلاعات به عنوان ورودی یک سیستم پیش بینی استفاده شود. برای پیش بینی وضعیت آب و هوایی در بیشتر مطالعات از روشهای رگرسیون استفاده شده است. یکی از روشهای که می‌توان برای یادگیری و پیش بینی آب و هوایی از آن استفاده نمود، شبکه‌های یادگیری عمیق و از جمله شبکه عصبی کانولوشن می‌باشد. یکی از چالش‌های مهم شبکه عصبی کانولوشن آن است که انتخاب ویژگی را غیر هوشمندانه و با استفاده از تعدادی عملیات کانولوشن انجام می‌دهد. در این مقاله برای بهبود دادن دقت پیش بینی شرایط آب و هوایی توسط شبکه عصبی کانولوشن، یک روش هوش گروهی ارایه شده است. در روش پیشنهادی در لایه اول به جای آنکه از عملیات کانولوشن برای انتخاب ویژگی استفاده شود از ترکیب شبکه عصبی چند لایه و الگوریتم حشره آبسوار برای انتخاب ویژگی استفاده می‌شود. انتخاب هوشمندانه ویژگی در لایه اول شبکه کانولوشن، دقت آن را در پیش بینی وضعیت آب و هوایی افزایش می‌دهد. ارزیابی‌ها با استفاده از مجموعه داده‌های مرتبط با شرایط آب و هوایی نشان می‌دهد روش پیشنهادی دارای دقت و حساسیتی به ترتیب برابر 96.32% و 96.14% در پیش بینی آب و هوا است. روش پیشنهادی نسبت به شبکه یادگیری عمیق CNN، توانسته دقت پیش بینی را در حدود 8.35% افزایش دهد.

کلیدواژه‌ها


عنوان مقاله [English]

Optimizing convolutional neural network with Water strider algorithm in weather forecasting

نویسندگان [English]

  • sharareh malboosi 1
  • hamidreza ghaffari 2
  • samira shahraki 3
1 Climatology Research Institute-Climatic Disasters Group-Mashhad-Iran
2 Ferdous - Islamic Azad University - Faculty - Assistant Professor - University President
3 PHD student
چکیده [English]

Abstract:

One of the most important and practical issues in today's world is weather forecasting. Forecasting the weather condition reduces the losses and damages of critical weather conditions. Weather forecasting can be effective in applications such as agriculture and air transportation. One of the methods that can be used to learn and predict the weather is deep learning networks, including convolutional neural networks. One of the important challenges of the convolutional neural network is that it performs feature selection unintelligent by using a number of convolution operations. In this article, a collective intelligence method is presented to improve the accuracy of forecasting weather conditions by convolutional neural network. The evaluations using the data sets related to weather conditions show that the proposed method, which has an accuracy and sensitivity of 96.32% and 96.14%, respectively, compared to the CNN deep learning network, has been able to achieve prediction accuracy of about increase by 8.35%.

Keywords: weather forecasting, convolutional neural network, feature selection, water strider algorithm

1 .Introduction

Weather conditions are an interesting and complex subject and very variable. With the change of weather and the occurrence of storms, floods, etc. Currently, there is no effective way to prevent the consequences of damaging weather conditions, so prevention should be prioritized. Today, machine learning and deep learning are considered as two subsets of artificial intelligence systems and are widely used in weather forecasting. One of the practical methods for predicting weather conditions is using the deep learning technique of convolutional neural network. This method also has challenges, one of which is unintelligent feature selection. Another challenge of this method is that the weights used in this network are not necessarily chosen optimally. To solve these challenges and to increase the accuracy of the convolutional neural network in this article, collective intelligence is used to reduce the prediction error.

2 .Research background

In the field of predicting weather variables using neural networks, some researches have been conducted and we will discuss some of them. As an example, in research [1], they presented a statistical and machine learning method for weather forecasting. The results showed that by combining automatic feature engineering with machine learning approaches, the prediction accuracy can be increased. In research [2], they presented a neural network for effective weather forecasting using time series data from the local weather station. The experimental results of the tests show that the proposed model using convolutional neural network provides better prediction compared to LSTM artificial neural network and other classical machine learning methods.





3 .Suggested method

In this section, a proposed method for improving the convolutional neural network using group intelligence of water-borne insects is presented and introduced.

3-1 .Convolution neural network

Convolutional neural networks are a class of deep neural networks. CNNs are very different from other pattern recognition algorithms because CNNs combine feature extraction and classification. Figure (1) shows a simple example of a basic CNN.



3-2- Water strider algorithm

One of the interesting behavior of collective intelligence that has been presented recently is the behavior of water bug algorithm. In this algorithm, behaviors such as foraging and mating are used to find the optimal solution and search the problem space. which is shown in figure (2).



4- Analysis of the proposed method

In the proposed method for analysis, it is evaluated in the MATLAB implementation environment. In the diagram of Figure (4), the value of the fitness function is displayed according to the repetition of the proposed algorithm. The evaluations show that the value of the fitness function is decreasing according to the repetition of the proposed algorithm in forecasting the weather condition.

To evaluate the proposed method based on accuracy and sensitivity indicators in predicting the weather condition from counting correct positive samples (TP), false positive samples (FP), correct negative samples (TN) and samples false negative (FN) is used.



The evaluations show that the proposed method has been able to increase the prediction accuracy by about 8.35% compared to the CNN deep learning network. Here, to complete the experiments, the proposed method is compared with the results of the article [4], which was presented in 2021. In table (1), the MAE and MSE index of the proposed method is compared with other methods.



According to the conducted experiments, the MAE and MSE index in predicting the weather condition, the error of the proposed method in predicting the weather condition is less than other methods.

4- Conclusion

Today, weather forecasting is an important research topic and is used for applications such as agriculture and travel planning. One of the methods of forecasting the weather condition is the use of machine learning and deep learning methods such as convolutional neural network. In this article, at first, the selection of features is done with the water strider algorithm, and then the important features related to the weather conditions are delivered to the convolutional neural network so that the weather conditions can be predicted.

The evaluations show that the proposed method is more accurate in terms of accuracy and sensitivity index for predicting weather conditions than artificial neural network, decision tree, logistic regression and convolutional neural network.

Reference:

1. Ioannou, K., Karampatzakis, D., Amanatidis, P., Aggelopoulos, V., & Karmiris, I. (2021). Low-Cost Automatic Weather Stations in the Internet of Things. Information, 12(4), 146.

2. Wolff, S., O'Donncha, F., & Chen, B. (2020). Statistical and machine learning ensemble modelling to forecast sea surface temperature. Journal of Marine Systems, 208, 103347.

3. Hewage, P., Behera, A., Trovati, M., Pereira, E., Ghahremani, M., Palmieri, F., & Liu, Y. (2020). Temporal convolutional neural (TCN) network for an effective weather forecasting using time-series data from the local weather station. Soft Computing, 24(21), 16453-16482.

4. Bączkiewicz, A., Wątróbski, J., Sałabun, W., & Kołodziejczyk, J. (2021). An ANN Model Trained on Regional Data in the Prediction of Particular Weather Conditions. Applied Sciences, 11(11), 4757.

کلیدواژه‌ها [English]

  • weather forecasting
  • convolutional neural network
  • feature selection
  • water strider algorithm
  1. Azari and M. Tabesh, "Urban storm water drainage system optimization using a sustainability index and LID/BMPs," Sustainable Cities and Society, vol. 76, p. 103500, 2022.
  2. Azizi and C. I. Meier, "Urban Pluvial Flood Risk Assessment: Challenges and Opportunities for Improvement Using a Community-Based Approach," in World Environmental and Water Resources Congress 2021, pp. 350-361, 2021.
  3. Palamuttam, R. Palamuttam, R. M. Mogrovejo, C. Mattmann, B. Wilson, K. Whitehall, R. Verma, L. McGibbney and P. Ramirez, "SciSpark: Applying in-memory distributed computing to weather event detection and tracking," in 2015 IEEE international conference on Big data (Big data), pp. 2020-2026: IEEE, 2015.
  4. Tasnádi, F. Bock, J. Tidholm, A. V. Shapeev, and I. A. Abrikosov, "Efficient and accurate prediction of elastic properties of Ti0. 5Al0. 5N at elevated temperature using machine learning interatomic potential," Thin Solid Films, p. 138927, 2021.
  5. Gupta, H. Mittal, D. Rikhari, and A. K. Singh, "MLRM: A Multiple Linear Regression based Model for Average Temperature Prediction of A Day," arXiv preprint arXiv:2203.05835, 2022.
  6. Refonaa and M. Lakshmi, "Remote sensing based rain fall prediction using big data assisted integrated routing framework," Journal of Ambient Intelligence and Humanized Computing, pp. 1-11, 2021.
  7. Cheng, Z. Zheng, J. Wang, L. Yang, and S. Wan, "Attribute reduction based on genetic algorithm for the coevolution of meteorological data in the industrial internet of things," Wireless Communications and Mobile Computing, vol. 2019, 2019.
  8. Karevan and J. A. Suykens, "Transductive LSTM for time-series prediction: An application to weather forecasting," Neural Networks, vol. 125, pp. 1-9, 2020.
  9. Dhamodharavadhani and R. Rathipriya, "Region-wise rainfall prediction using mapreduce-based exponential smoothing techniques," in Advances in big data and cloud computing: Springer, pp. 229-239, 2019.
  10. Soares, P. Costa Jr, B. Costa, and D. Leite, "Ensemble of evolving data clouds and fuzzy models for weather time series prediction," Applied Soft Computing, vol. 64, pp. 445-453, 2018.
  11. I. Rasel, N. Sultana, and P. Meesad, "An application of data mining and machine learning for weather forecasting," in International conference on computing and information technology, pp. 169-178: Springer, 2017.
  12. Sahoo, "A Parallel Forecasting Approach Using Incremental K-means Clustering Technique," in Computational Intelligence in Data Mining: Springer, pp. 165-172, 2017.
  13. C. Onal, O. B. Sezer, M. Ozbayoglu, and E. Dogdu, "Weather data analysis and sensor fault detection using an extended IoT framework with semantics, big data, and machine learning," in 2017 IEEE International Conference on Big Data (Big Data), pp. 2037-2046: IEEE, 2017.
  14. Kaveh and A. D. Eslamlou, "Water strider algorithm: A new metaheuristic and applications," in Structures, vol. 25: Elsevier, pp. 520-541, 2020.
  15. M. S. Hasan and A. M. Abdulazeez, "A review of principal component analysis algorithm for dimensionality reduction," Journal of Soft Computing and Data Mining, vol. 2, no. 1, pp. 20-30, 2021.
  16. Wu, Y. Wang, X. Zhang, and Z. Chen, "A novel state of health estimation method of Li-ion battery using group method of data handling," Journal of Power Sources, vol. 327, pp. 457-464, 2016.
  17. Vang-Mata, Multilayer Perceptrons: Theory and Applications. Nova Science Publishers, 2020.


 B. Azari, K. Hassan, J. Pierce, and S. Ebrahimi, "Evaluation of machine learning methods application in temperature prediction," Environ Eng, vol. 8, pp. 1-12, 2022.