Survey of Rainfall Prediction Using Deep Learning
Survey of Rainfall Prediction Using Deep Learning
Abstract— Prediction of rainfall is a difficult task because of on how the neural networks can predict various weather
the high volatility and complicated nature of the atmospheric phenomena such as temperature, tidal level, rainfall, and
data. Recently, various deep learning methods were successfully flood. A survey of satellite-based rainfall prediction technique
applied to forecast rainfall. We survey papers that employ deep was presented by [18]. [19] presented a study of statistical
learning techniques to predict rainfall using meteorological methods and data mining techniques for the prediction of
data. The papers are examined in terms of the deep learning rainfall. [20] provided a critical study of papers published
methods applied, location of the study area, types of metrics and from 2013 to 2017 for rainfall prediction based on data mining
software used for implementing the model and, year-wise techniques. Recently, there is an increasing interest in the use
publication of the papers. From the surveyed papers, we found
of deep learning for rainfall prediction, however there is a lack
that deep learning methods can be applied successfully for
rainfall prediction and they are found to be superior than the
of survey papers that focused on rainfall prediction using deep
traditional machine learning methods and shallow neural learning methods. Thus, the purpose of this paper is to fill this
network models. We also provide future directions for research gap and study the papers that used deep learning methods for
in the area of rainfall prediction. the prediction of rainfall. We classify the papers based on the
nature of data used to train and test the deep learning models.
Keywords— Rainfall prediction, Artificial neural network, We study the types of metrics and software used, yearly trends
Machine Learning, Deep Learning of the papers published, the location of the case study, and the
type of deep learning methods applied for the prediction.
I. INTRODUCTION Furthermore, we also discuss the performance of deep
Accurate rainfall prediction is necessary because of its learning models compared to machine learning models and the
impact in the fields of agriculture, transportation, water potential future research directions.
supply, renewable energy management and, various activities This paper is organized as follows. Section II discusses the
of human beings. As rainfall prediction depends on multiple methodology for conducting the survey. In section III, we
environmental factors, it is a challenging task [1]. Rainfall summarized the deep learning methods applied for the
prediction methods can be categorized into physical methods, prediction of rainfall. Section IV presents the result and
statistical methods, and machine learning techniques. Physical discussion and in section V we mention the future directions.
methods are models that are implemented using numerical Finally, the conclusion is given in section VI.
weather prediction. Physical methods have a drawback
because they require large computational resources and large II. METHODOLOGY
data requirements for calibrating the model. On the other
The process of this survey consists of the following steps:
hand, the statistical model aims to uncover the mathematical
(a) Collection of papers with a focus on the use of deep
relationship between online time-series problems.
learning methods for rainfall prediction (b) detailed survey
Autoregressive Integrated Moving Average (ARIMA),
and analysis of the collected papers.
Multiple Regression and, Linear Regression (LR) are
commonly used in statistical modelling. For many years In the first step, well-known digital libraries such as
researchers have applied machine learning models for ScienceDirect, IEEE Xplore, Springer, and Google Scholar
prediction of rainfall [1]–[5]. Support Vector Machine (SVM) were searched for Journal articles and Conference paper using
and neural network model such as Artificial Neural Network the combination of keywords given below: -
(ANN) are commonly used machine learning models for
rainfall prediction. A type of Machine learning model called [“deep learning” OR “machine learning”] AND [“rainfall”
Deep learning model implement deep structure in its OR “precipitation] AND [“forecasting” OR “prediction”]
architecture. It is a composition of several processing layers to Using the search criteria given above, 246 papers were
learn the data representations using multiple level of collected. The collected papers were screened and 45 papers
abstraction [6]. Deep learning methods are employed were selected for the detailed study after applying the
successfully in the area of forecasting, classification problem, following inclusion criteria: -
image and natural language processing, speech recognition,
object detection, etc. [7]–[14]. 1) Papers published from January 2015 to June 2020
2) Papers from peer-reviewed journals and conferences.
Rainfall forecasting has been an active area in literature. 3) Papers that predict rainfall
Several survey papers that applied machine learning models
4) Papers that used deep learning methods
in forecasting rainfall and other weather parameters have been
published. [15] presented an overview of various
computational intelligence tools for weather prediction aiming
[24] used a deep learning technique called Denoising [30] applied deep learning model called Deep Belief
Autoencoder (DAE) and a Multilayer Perceptron (MLP) for Network (DBN) for precipitation forecasting. DBN was
predicting the next day's rainfall. The autoencoder extract compared with SVM and SVM based on different
non-linear features from the input meteorological data and the optimization algorithms such as Particle Swarm Optimization
MLP network is used for classification and prediction. The (PSO). The time consumed by DBN was lower than the SVM
authors compared the proposed model with MLP, naive methods, and it was founded that SVM methods can be used
approach, Back Propagation network (BP), Layer Recurrent for small datasets whereas the DBN method can be used for
Network (LRN), Cascaded Back-Propagation (CBP), large-scale datasets.
Ensemble Empirical Mode Decomposition (EEMD), and Very Short-Term precipitation forecasting was studied by
Feed-forward Neural Networks (FNN). The result showed that [31] and compared the performance of Deep Neural Network
the proposed method achieved lower Mean Squared Error (DNN) with SVM, XGBoost (XGB), Random Forest (RF),
(MSE) and Root Mean Squared Error (RMSE) than the and Random Prediction (RP) methods. Among the compared
compared methods. methods, DNN yields the highest accuracy for rain prediction.
[25] predicted heavy rainfalls during the monsoon season [32] investigated the capability of DNN to predict monthly
(June, July, August, and September). Due to a huge set of rainfall. After testing different hidden layers and hidden
features, Stacked Autoencoder (SAE) was used as a tool for nodes, the authors considered 5 hidden layers with 128 nodes
feature reduction. The reduced features are then used for the in each layer for the DNN model. Based on the results, the
classification of heavy rainfalls using a cost-sensitive SVM. DNN model was found to be appropriate for forecasting
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
monthly rainfall with a one-month lead time. The accuracy of (ARIMA), Autoencoder Multilayer Perceptron (AE-MLP),
the model was decreased when increasing the lead time. Multitasking Convolutional Neural Network (MT-CNN),
Multitasking Gated Recurrent Unit (MT-GRU). For a single
[33] compared the performance of LSTM with MLP and time-step, the proposed model provides a lower Root Mean
Seasonal Neural Networks (SNN) for predicting rainfall. The
Squared Error (RMSE) than the compared models. In the case
result of the experiment suggested that LSTM was better in of a multi-step model with a rolling mechanism to forecast the
terms of performance than the compared methods. The next 6-time steps, the proposed model is found to be useful but
authors stated that LSTM can be a promising model for
limit accuracy.
estimating precipitation.
[39] proposed Intensified LSTM for the prediction of
[34] applied LSTM for forecasting monthly rainfall and rainfall. To solve the issue of the LSTM vanishing gradient
explores the selection of optimal time lag for the model. The problem, the authors modified the LSTM by multiplying the
LSTM model was compared with RNN and it was tested on input value with the sigmoid function in the input gate and the
various homogeneous regions of India. The study observed tanh function in the candidate vector. This reduced the training
that the LSTM model outperformed the RNN model for time of the network which in turn caused a high learning rate
different fitness measures and 12 to 15 antecedent rainfall and reduced the losses. The proposed Intensified LSTM
events provide more valuable information. model was compared with Holt-Winters, Extreme Learning
[35] developed a deep neural network composed of Machine (ELM), ARIMA, Recurrent Neural Network (RNN
convolutional layers and an LSTM network for improving with Rectified Linear Unit (ReLU), RNN with Sigmoid Linear
Monsoon precipitation prediction. The convolutional layers Unit (SiLU), and LSTM models. Experimental results showed
were used to extract spatial features of the raw input data, that the accuracy of the proposed model outperformed the
which was then fed to the LSTM networks. The effectiveness compared models.
of the predictors was studied and the geopotential height was [40] developed two LSTM based models, Wavelet Long
found to be the most important predictor. The proposed
Short-Term Memory (WLSTM) and CLSTM to forecast
Convolutional Long Short-Term Memory (ConvLSTM) streamflow and rainfall. WLSTM is a hybrid model composed
model was compared with Quantile Mapping (QM) method,
of LSTM and wavelet transform and CLSTM is composed of
SVM, and CNN and the precipitation estimate given by the CNN and LSTM. WLSTM and CLSTM models were
ConvLSTM network was found to have the highest
compared with three layers MLP and LSTM. Results showed
performance. that WLSTM and CLSTM outperformed LSTM and MLP for
[36] proposed the identification of break and active both stream fall and rainfall forecasting. The forecasting
monsoon spells for the central region of the Indian accuracy of LSTM was improved using the wavelet transform
subcontinent using LSTM and Sequence-to- and convolutional layers.
Sequence (Seq2Seq) models. The Seq2Seq model consists of [41] adopted a deep learning model called LSTM and K-
two LSTM units, a dense soft-max layer, and an attention Means clustering method. The data samples were first divided
mechanism. The authors classified each day as dry, wet, or into four categories using the K-means clustering method
normal day. Then the collection of classification at daily scale followed by building the models using LSTM for the different
was used to detect the break or active monsoon spells. Daily
data types. The proposed model was compared with
rainfall from June to September (1948 - 2014) was considered Frequency matching, Linear regression, SVM, and DBN
for detection of monsoon spells. The proposed models were
using RMSE and Threat Score (TS). The proposed model was
compared with SVM and K-Nearest Neighbor (KNN) and it found to reduce the RMSE effectively and it improved the TS
was observed that both LSTM and Seq2Seq performed better of light and heavy rain.
than SVM and KNN. Additionally, the Seq2Seq model was
found to be superior to LSTM for detecting monsoon spells. [42] constructed and trained a deep CNN model for severe
convective weather such as heavy rain, hail, convective gusts,
[37] used Echo State Networks (ESN) and DeepESN to and thunderstorms. The authors constructed two databases
predict rainfall using meteorological data. The study was based on Severe Convective Weather (SCW) observations and
conducted in the area of Southern Taiwan. The authors NCEP final (FNL) analysis data. The proposed CNN model
compared the performance of the proposed models with Back
was compared with Logistic Regression (Logit Reg), Random
Propagation Network (BPN) and SVR. To find the most Forest (RF), Support Vector Machine (SVM), and Multilayer
important parameter to predict rainfall, the authors used the Perceptron (MLP). Results showed that the deep CNN model
Principal Component Analysis (PCA) method. Rainfall, outperformed the compared traditional machine learning
pressure, and humidity are found to be the most important
algorithms in SCW forecasting over China.
parameters. The experimental result showed that the
correlation coefficient for the ESN and DeepESN is greater ConvLSTM tuned using the Salp-Stochastic Gradient
than BPN and SVR model. It was also found that DeepESN Descent (S-SGD) algorithm was proposed by [43] for the
was more accurate and has the best performance than the prediction of rainfall in India. S-SGD algorithm is a hybrid of
compared models. Salp Swarm Algorithm (SSA) and Stochastic Gradient
Descent (SGD) algorithm and they are used to select the
[38] proposed a cascading deep learning method to
optimal weights of the ConvLSTM model. The authors
classify rain/no-rain and to predict the amount of rainfall. implemented the MapReduced framework to deal with a large
CNN was used as a classification model to classify rain or no- amount of data in parallel. The performance of the model was
rain and using the classified rain class Gated Recurrent Unit compared with ConvLSTM, Clusterwise linear regression
(GRU) was used to predict the amount of rainfall. Focal loss (CLR), MLP, and Dynamic Self-organizing Multilayer
with sigmoid activation was used by the authors to prevent Network Inspired by the Immune Algorithm (DSMIA). It is
bias to non-rain class. The proposed cascaded model was found that the proposed model S-SGD based ConvLSTM
compared with Autoregressive Integrated Moving Average
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
TABLE I. SUMMARY OF PAPERS WHICH PREDICT RAINFALL USING WEATHER PARAMETERS
[45] MIMO‐LSTM, SR, SVR, RF, ARIMA, VAR, Keras 3 hours TS, ETS, POD, FAR
MISO‐LSTM, VECM, AFE, WRF-NWP
MIMO‐TCN,
MISO‐TCN,
[44] Stacked LSTM ANN, GRU - Australia 30 secs, RMSE, MAE, R2,CV,Bias
15 mins
outperformed the compared models in terms of Percentage GRU and much better than ANN in terms of RMSE, Mean
Root mean square Difference (PRD) and Mean Squared Error Absolute Error (MAE), Coefficient of Determination (R2),
(MSE). and Coefficient of Variation (VC).
[44] designed a deep learning model based on a two-layer [45] proposed LSTM and Temporal Convolutional
LSTM model and trained the model using a disdrometer- Networks (TCN) for short-term forecasting of rainfall using
derived dataset. The model was then applied to improve 10 surface weather parameters. They compared the
rainfall estimation using Commercial Microwave Link (CML) performance of the models with Standard Regression (SR),
data. Based on the attenuation of the transmitted SVR, RF, ARIMA, Vector Auto Regression (VAR), Vector
electromagnetic signal as it passed through the rain, rainfall Error Correction Model (VECM), and Arbitrage of
was estimated using CML networks. The authors compared Forecasting Expert (AFE) models. Two regression models
the LSTM model with GRU and ANN. The results showed namely Multi-Input Multi-Output (MIMO) and Multi-Input
that GRU performed better than LSTM in terms of relative Single-Output (MISO) were proposed to evaluate the
bias, whereas the LSTM model performed slightly better than proposed models. MIMO-LSTM and MISO-LSTM
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
outperformed the compared models and they were selected as To enable researchers to develop, test and deploy new
the proposed model. Since MISO-LSTM and MIMO-LSTM models significantly faster [51] studied a distributed learning
do not produce much difference and due to easily handle and approach to train a precipitation nowcasting model. In this
less time and power consumption MIMO-LSTM was selected study, a data-parallel model was implemented in which a CNN
for further analysis. Then, the author compared the MIMO- model and the training batches were replicated across multiple
LSTM with Weather Research and Forecasting - Numerical compute nodes. The CNN model was Fully Convolutional
Weather Prediction (WRF-NWP) model and found that without dense layers. The authors implemented the model
MIMO-LSTM provides better prediction up to 12 hours. using TensorFlow/Keras and Horovod framework and the
model was trained using up to 128 GPUs. Using the proposed
B. Rainfall prediction using Radar image approach, the training time for a given nowcasting model
To increase the spatial coverage and resolution of the data, architecture was reduced from 59 hours to just about 1 hour.
radar images are widely used by researchers to predict rainfall. The result also showed that the validation loss reduced
In Table II we summarized the papers that used radar images smoothly up to 24 GPUs. A noisy behavior was detected in
for the prediction of rainfall. [46] proposed convolutional the validation loss after increasing the number of GPUs
LSTM (ConvLSTM) for short-term rainfall prediction. The beyond 24 which could be due to a significant reduction in the
authors extended the Fully Connected LSTM (FC-LSTM) by training images available for each device.
incorporating convolutional structures in the input-to-state
and state-to-state transitions. ConvLSTM is compared against [52] proposed a Generative Adversarial ConvGRU (GA-
FC-LSTM and the Real-time Optical flow by Variational ConvGRU) model which is a composition of two adversarial
methods for Echoes of Radar (ROVER). The FC-LSTM does learning systems, ConvGRU-based generator, and a
not perform very well due to the spatial correlation in the radar convolutional neural-network-based discriminator. The
data. ROVER is found to give a sharper prediction, but it authors utilized a sequence of five radar echo images and
triggers more False alarms and is found to be less precise than predict ten radar echo maps. Results of the experiments
ConvLSTM. The authors concluded that ConvLSTM is better showed that GA-ConvGRU outperformed ConvGRU and
in capturing the spatiotemporal correlations and it also optical flow methods.
provides better predictions than the ROVER algorithm. [53] compared the performance of U-Net CNN with the
[47] predicted short-term precipitation using Optical flow model, persistence model, and NOAA's
Convolutional Long Short-Term Memory (convLSTM) using numerical one-hour High-Resolution Rapid Refresh (HRRR)
the radar data. Hyper-parameter search was performed using for short-term precipitation prediction. The authors treated the
Spearmint to select the convolutional kernel size, the number forecasting problem as an image-to-image translation problem
of convolutional filters, learning rate, and momentum. The where n sequence of radar images was used as input to the
results show that the standard encoder-decoder method is model. The study showed that the proposed model
more successful in Probability of Detection (POD) and outperformed the compared models.
Critical Success Index (CSI) and only a slight increase in false [54] proposed sequence-to-sequence model called dec-
alarm over the attention model. seq2seq model. The dec-seq2seq model consists of dec-
[48] proposed a Trajectory Gated Recurrent Unit TrajGRU, dec-ConvGRU, and dec-ConvLSTM. The dec-
(TrajGRU) for short-term rainfall prediction and compared its seq2seq models were compared with TrajGRU, ConvGRU,
performance with Convolutional Gated Recurrent Unit and ConvLSTM and showed improvements over the
(ConvGRU), Dynamic Filter Network (DFN), 2D and 3D compared models. Among the dec-seq2seq models, dec-
Convolutional Neural Networks (CNNs), and two optical TrajGRU performed better than the other models. To resolve
flow-based models (ROVER and its nonlinear variant). Due the blurry image issue due to the impact of the loss functions
to high imbalance in the proportions of rainfall events at such as MAE or MSE, an image quality assessment metrics
different rain-rate, the authors also proposed Balanced Mean Structural Similarity (SSIM) and Multi-Scale Structural
Square Error (B-MSE) and Balanced Mean Absolute Error (B- Similarity (MS-SSIM) were proposed by the authors. The
MAE) for training and evaluation of the models. The experimental result showed that the best loss function is
experiments show that TrajGRU outperforms the compared combination of SSIM, MSE, and MAE and the dec-seq2seq
models and training of the models using the balanced loss models can tolerate high and increasing uncertainty.
function performs better than training without balanced loss. To improve the accuracy of Doppler radar detection of
[49] explored the prediction of rainfall using a radar echo short-term rainfall prediction, Tiny-RainNet was proposed by
dataset by incorporating convolution operations within the [55]. Tiny-RainNet consists of a combination of Bi-directional
vanilla recurrent neural network. The proposed Conv-RNN Long Short-Term Memory (BiLSTM) and CNN to extract the
model was compared against Conv-LSTM and Eulerian temporal and spatial information. The authors compared the
Persistence models. The authors states that Conv-RNN can be proposed model with ConvLSTM, LSTM, FC-LSTM, and
used for learning the features of the Doppler weather radar AlexNet and it was found that Tiny-RainNet had a better
phenomenon and lesser parameters are used compared to other performance than the compared models.
hybrid approaches. Convolutions in recurrence also encode [56] developed RainNet, a deep convolutional neural
the Spatio-temporal correlations. network for radar-based short-term precipitation forecasting.
DeepRain- a ConvLSTM model was proposed by [50] to RainNet model consists of a stacked of CNN following a
predict the amount of rainfall using radar observation. The standard encoder-decoder structure with skip connection
prediction accuracy of the proposed method is found to be between its branches. Initially, RainNet predicted the
better than Linear Regression and FC-LSTM models. The precipitation for a lead time of 5 minutes and to predict a larger
result also showed that the two-stacked ConvLSTM lead time up to 60 minutes. RainNet was applied recursively
performed more stable than the one-stacked ConvLSTM. by using the previous output as the next input. The
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
TABLE II. SUMMARY OF PAPERS WHICH PREDICT RAINFALL USING RADAR IMAGE
experimental result showed that RainNet significantly satellite observation provides coverage over a large area and
outperformed the benchmark models Rainymotion and at regular intervals [59]. There is multiple satellites launch for
persistence method at all lead times up to 60 minutes. observation of meteorological phenomena. For decades,
researchers have used the data provided by satellites for
ConvLSTM with a star-shaped bridge architecture was predicting rainfall and other meteorological phenomena. In
implemented by [57] for precipitation nowcasting and this section, we present the literature that implements deep
compared the performance of the model with Continuous learning methods for rainfall prediction using satellite images.
Tracking Radar Echo by Correlation (COTREC) and the
Table III summarizes the papers found in the literature.
ConvLSTM with cross-entropy loss. The authors used Group
Normalization to refine the convergence performance in [60] applied a Stacked Denoising Auto-Encoder (SDAE)
optimization for ConvLSTM and they employed a special for bias correction on satellite precipitation product. The
multisigmoid loss. Experimental results showed that the SDAE is used to improve the Precipitation Estimation from
proposed model achieved state-of-the-art performance. Remotely Sensed Imagery using an Artificial Neural Network
Cloud Classification System (PERSIANN-CCS). The model
[58] proposed Multihead Attention Residual was evaluated including the detection of Rain or No-Rain
Convolutional Neural Network (MAR-CNN) for short-term pixels and the detection of amount of rainfall for both warm
precipitation forecasting. The proposed method used two and cold seasons. The study shows that the proposed model
CNN architectures. The first CNN model extracts deep can detect false alarm pixels in the PERSIAN-CCS and it is
characteristics from radar images and the second CNN model also able to rectify the bias of the overall precipitation level in
acquired deep features from the non-image input. Multihead
the warm and cold seasons.
attention was also introduced by the authors to emphasize the
key areas corresponding to precipitation and a residual [61] forecasted short-term precipitation using Cloud-Top
connection to avoid global information loss which was caused Brightness Temperature (CTBT). To forecast the next value
by the attention layer. The authors compared the MAR-CNN of CTBT image, deep learning algorithm LSTM was proposed
model with dual-channel convolutional attention model, dual- and the Precipitation Estimation using Remotely Sensed
channel convolutional model, single-channel CNN model, Information using Artificial Neural Networks (PERSIANN)
Gradient Boosted Decision Tree (GBDT), and SVM. The algorithm was used for estimating precipitation from the
proposed model was found to have a better prediction forecasted CTBT image. The model was compared with RNN
performance than the compared models. with PERSIANN, the Persistency method with PERSIANN,
C. Rainfall prediction using Satellite image
The distribution of rain gauges and radar systems is
common but limited to their spatial coverage. In contrast,
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
TABLE III. SUMMARY OF PAPERS WHICH PREDICT RAINFALL USING SATELLITE IMAGE
Farneback optical flow with PERSIANN algorithm, and used to forecast precipitation up to 150 minutes. The proposed
Rapid Refresh (RAPv1.0). The proposed model shows model was compared with LSTM and four optical flow-based
superiority in short-term precipitation forecasting. methods- Sparse Single Delta (SparseSD), Sparse, Dense, and
Dense Rotation (DenseROT). Based on the authors
[62] proposed rainfall prediction using an ensemble experiment, LSTM was not suitable for data with Spatio-
approach based on a deep neural network. A Convolutional temporal information and Convcast outperformed the
LSTM was compared with Bayesian Model Averaging compared models.
(BMA) and Master Super Model Ensemble System (MSMES)
methods for predicting rainfall. The experimental results IV. RESULTS AND DISCUSSION
showed that the proposed model is 50% more precise than the A. Temporal distribution of studies
compared models.
In Fig. 1, we plot the temporal distribution of the 45 papers
[63] proposed precipitation nowcasting model based on selected for the study. The plotted graph shows an increasing
PredNet network architecture and compared with TrajGRU trend in the number of papers published in the area of rainfall
method. ConvGRU was used as the unit of PredNet instead of prediction using deep learning. In 2019, the number of papers
the ConvLSTM unit. The experiment showed that the grew significantly, which is 51% of the total papers. This
proposed model achieved state-of-the-art performance in the shows that there is an increasing interest in applying deep
MovingMNIST++ dataset and an acceptable result in the real learning methods for rainfall prediction. The decreased in the
precipitation data. The model also consumes less GPU number of papers from 2019 to 2020 is because we consider
memory compared to the TrajGRU model. up to the month of June only.
[64] proposed to merge the Tropical Rainfall Measuring B. Deep learning methods used for rainfall prediction
Mission (TRMM) 3B42 V7 satellite image, rain gauge output, In Fig. 2, the frequency of deep learning methods used by
and thermal infrared images to enhanced the accuracy of the authors for rainfall prediction is given. From this figure, it
quantitative precipitation estimation (QPE). The authors used can be seen that LSTM (10 papers) and ConvLSTM (9 papers)
a combination of CNN and LSTM models to extract the spatial are the most frequently used methods. AE and SAE are
characteristics and time dependence of the merged dataset and usually used by the authors to discover the predictor variables
compared the accuracy with CNN, LSTM, and MLP models. when the input variables are large. When the input is a satellite
The CNN-LSTM model considered the time and space image or a radar image, most of the authors used convolutional
dependence of precipitation, thus outperformed the compared layers for learning the features of the input. The convolution
models which considered either spatial information only or operators enable to learn the spatial information in addition to
temporal information only. The authors also showed that
under different precipitation intensities the CNN-LSTM 20
model can correct and improved the TRMM data.
Number of paper
15
A precipitation nowcasting model called Convcast was
published
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
China 17
10 India 9
10 9
USA 6
Number of articles
8 Thailand 2
6 Japan 2
4 Colombia
3 3 2
4
2 2 2 2 Vietnam 1
2 1 1 1 1 Taiwan 1
0 Germany 1
Brazil 1
ConvLSTM
ConvRNN
DeepESN
ESN
DBNPF
LSTM
CNN-GRU
MGGP
CNN
DBN
DNN
ConvGRU
CNN-LSTM
Australia 1
0 5 10 15 20
No. of papers
Fig. 2. Frequency of deep learning methods in the surveyed papers
the temporal information. We found that when compared with Fig. 3. Global distribution of the papers understudy
traditional machine learning models, deep learning models are
more accurate for rainfall prediction and they can capture the Correlation Coefficient (PCC), Probability of False Detection
temporal or spatial information of the input data. When the (PFD), Percentage Root mean square Difference (PRD),
input data consists of temporal information, traditional Stochastic Efficiency of Forecast (SEF), Nash–Sutcliffe
machine learning models cannot retain the past information Efficiency coefficient (NSE), Relative Bias (RB), Structural
which is required for predicting future rainfall. Similarity (SSIM), Success ratio and Variance.
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
VI. CONCLUSIONS Data,” Front. Artif. Intell., vol. 3, no. February, pp. 1–23, 2020, doi:
10.3389/frai.2020.00004.
Rainfall prediction is still a challenging task due to the [15] N. O. Bushara and A. Abraham, “Computational intelligence in
complex and non-linear nature of the weather variables. But weather forecasting: A review,” J. Netw. Innov. Comput., vol. 1, no. 1,
due to the high impact of rainfall in our daily lives, it is still a pp. 320–331, 2013, [Online]. Available:
high research area. In this paper, we have surveyed 45 papers www.mirlabs.net/jnic/index.html.
published by well-known publishers. We classify rainfall [16] D. R. Nayak and P. Mahapatra, Amitav\Mishra, “A Survey on Rainfall
prediction based on the type of data used by the authors. Prediction using Artificial Neural Network,” Int. J. Comput. Appl., vol.
72, no. 16, pp. 32–40, 2013.
Rainfall and other weather phenomenon are usually collected
[17] D. Chauhan and J. Thakur, “Data Mining Techniques for Weather
as the weather parameter value, radar image, and satellite Prediction: A Review,” Int. J. Recent Innov. Trends Comput. Commun.,
image. We study the deep learning methods applied, types of vol. 2, no. 8, pp. 2184–2189, 2014, [Online]. Available:
input data used for the predictor, the type of metrics applied http://ijritcc.org/IJRITCC Vol_2 Issue_8/Data Mining Techniques for
for testing the performance of the models, and the software Weather Prediction A Review.pdf.
used for implementing the models. We also study the temporal [18] S. Sarumathi, N. Shanthi, and S. Vidhya, “Satellite Rainfall Prediction
and spatial distribution of the study. In conclusion, we find Techniques - A State of the Art Review,” Int. J. Environ. Chem. Ecol.
Geol. Geophys. Eng., vol. 9, no. 2, pp. 144–151, 2015.
that deep learning methods performed better and they are more
[19] N. Mishra, H. K. Soni, S. Sharma, and A. K. Upadhyay, “A
preferable compared to traditional machine learning models or comprehensive survey of data mining techniques on time series data
shallow neural network architecture for the task of rainfall for rainfall prediction,” J. ICT Res. Appl., vol. 11, no. 2, pp. 167–183,
prediction. 2017, doi: 10.5614/itbj.ict.res.appl.2017.11.2.4.
[20] S. Aftab, M. Ahmad, N. Hameed, M. S. Bashir, I. Ali, and Z. Nawaz,
ACKNOWLEDGMENT “Rainfall prediction using data mining techniques: A systematic
literature review,” Int. J. Adv. Comput. Sci. Appl., vol. 9, no. 5, pp. 143–
The authors would like to acknowledge the reviewers for their
150, 2018, doi: 10.14569/IJACSA.2018.090518.
valuable time and feedback.
[21] M. Saha, P. Mitra, and R. S. Nanjundiah, “Autoencoder-based
identification of predictors of Indian monsoon,” Meteorol. Atmos.
REFERENCES Phys., vol. 128, no. 5, pp. 613–628, 2016, doi: 10.1007/s00703-016-
[1] Y. Dash, S. K. Mishra, and B. K. Panigrahi, “Rainfall prediction for the 0431-7.
Kerala state of India using artificial intelligence approaches,” Comput. [22] M. Saha, P. Mitra, and R. S. Nanjundiah, “Deep learning for predicting
Electr. Eng., vol. 70, no. June, pp. 66–73, 2018, doi: the monsoon over the homogeneous regions of India,” J. Earth Syst.
10.1016/j.compeleceng.2018.06.004. Sci., vol. 126, no. 4, pp. 1–18, 2017, doi: 10.1007/s12040-017-0838-7.
[2] M. N. French, W. F. Krajewski, and R. R. Cuykendall, “Rainfall [23] M. Saha, A. Santara, P. Mitra, A. Chakraborty, and R. S. Nanjundiah,
forecasting in space and time using a neural network,” J. Hydrol., vol. “Prediction of the Indian summer monsoon using a stacked
137, no. 1–4, pp. 1–31, 1992, doi: 10.1016/0022-1694(92)90046-X. autoencoder and ensemble regression model,” Int. J. Forecast., vol. 37,
[3] A. Manzato, “Sounding-derived indices for neural network based no. 1, pp. 58–71, 2020, doi: 10.1016/j.ijforecast.2020.03.001.
short-term thunderstorm and rainfall forecasts,” Atmos. Res., vol. 83, [24] E. Hernández, V. Sanchez-Anguix, V. Julian, J. Palanca, and N. Duque,
no. 2-4 SPEC. ISS., pp. 349–365, 2007, doi: “Rainfall prediction: A deep learning approach,” in Lecture Notes in
10.1016/j.atmosres.2005.10.021. Computer Science (including subseries Lecture Notes in Artificial
[4] H. Meyer, M. Kühnlein, T. Appelhans, and T. Nauss, “Comparison of Intelligence and Lecture Notes in Bioinformatics), 2016, vol. 9648, doi:
four machine learning algorithms for their applicability in satellite- 10.1007/978-3-319-32034-2_13.
based optical rainfall retrievals,” Atmos. Res., vol. 169, pp. 424–433, [25] S. Gope, S. Sarkar, P. Mitra, and S. Ghosh, “Early prediction of
2016, doi: 10.1016/j.atmosres.2015.09.021. extreme rainfall events: A deep learning approach,” in Advances in
[5] S. Cramer, M. Kampouridis, A. A. Freitas, and A. K. Alexandridis, “An Data Mining. Applications and Theoretical Aspects. ICDM 2016,
extensive evaluation of seven machine learning methods for rainfall 2016, vol. 9728, pp. 154–167, doi: 10.1007/978-3-319-41561-1_12.
prediction in weather derivatives,” Expert Syst. Appl., vol. 85, pp. 169– [26] P. Zhang, L. Zhang, H. Leung, and J. Wang, “A Deep-Learning Based
181, 2017, doi: 10.1016/j.eswa.2017.05.029. Precipitation Forecasting Approach Using Multiple Environmental
[6] Y. Lecun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. Factors,” in Proceedings - 2017 IEEE 6th International Congress on
521, no. 7553, pp. 436–444, 2015, doi: 10.1038/nature14539. Big Data, BigData Congress 2017, 2017, pp. 193–200, doi:
[7] C. Shen, “A Transdisciplinary Review of Deep Learning Research and 10.1109/BigDataCongress.2017.34.
Its Relevance for Water Resources Scientists,” Water Resour. Res., vol. [27] P. Zhang, Y. Jia, L. Zhang, J. Gao, and H. Leung, “A deep belief
54, no. 11, pp. 8558–8593, 2018, doi: 10.1029/2018WR022643. network based precipitation forecast approach using multiple
[8] S. Khan and T. Yairi, “A review on the application of deep learning in environmental factors,” Intell. Data Anal., vol. 22, no. 4, pp. 843–866,
system health management,” Mech. Syst. Signal Process., vol. 107, pp. 2018, doi: 10.3233/IDA-173427.
241–265, 2018, doi: 10.1016/j.ymssp.2017.11.024. [28] Q. Ouyang and W. Lu, “Monthly Rainfall Forecasting Using Echo
[9] W. Nash, T. Drummond, and N. Birbilis, “A review of deep learning State Networks Coupled with Data Preprocessing Methods,” Water
in the study of materials degradation,” npj Mater. Degrad., vol. 2, no. Resour. Manag., vol. 32, no. 2, pp. 659–674, 2017, doi:
1, pp. 1–12, 2018, doi: 10.1038/s41529-018-0058-x. 10.1007/s11269-017-1832-1.
[10] S. Pouyanfar et al., “A Survey on Deep Learning,” ACM Comput. [29] M. Qiu et al., “A short-term rainfall prediction model using multi-task
Surv., vol. 51, no. 5, pp. 1–36, 2019, doi: 10.1145/3234150. convolutional neural networks,” Proc. - IEEE Int. Conf. Data Mining,
ICDM, vol. 2017-Novem, pp. 395–404, 2017, doi:
[11] S. Dargan, M. Kumar, M. R. Ayyagari, and G. Kumar, “A Survey of 10.1109/ICDM.2017.49.
Deep Learning and Its Applications: A New Paradigm to Machine
Learning,” Arch. Comput. Methods Eng., vol. 27, no. 4, pp. 1071–1092, [30] J. Du, Y. Liu, and Z. Liu, “Study of precipitation forecast based on deep
2020, doi: 10.1007/s11831-019-09344-w. belief networks,” Algorithms, vol. 11, no. 9, pp. 1–11, 2018, doi:
10.3390/a11090132.
[12] H. Ismail Fawaz, G. Forestier, J. Weber, L. Idoumghar, and P. A.
Muller, “Deep learning for time series classification: a review,” Data [31] K. Yonekura, H. Hattori, and T. Suzuki, “Short-term local weather
Min. Knowl. Discov., vol. 33, no. 4, pp. 917–963, 2019, doi: forecast using dense weather station by deep neural network,” in
10.1007/s10618-019-00619-1. Proceedings - 2018 IEEE International Conference on Big Data, Big
Data 2018, 2018, pp. 1683–1690, doi:
[13] L. Zhou, C. Zhang, F. Liu, Z. Qiu, and Y. He, “Application of Deep 10.1109/BigData.2018.8622195.
Learning in Food: A Review,” Compr. Rev. Food Sci. Food Saf., vol.
18, no. 6, pp. 1793–1811, 2019, doi: 10.1111/1541-4337.12492. [32] U. Weesakul, P. Kaewprapha, K. Boonyuen, and O. Mark, “Deep
learning neural network: A machine learning approach for monthly
[14] F. Emmert-Streib, Z. Yang, H. Feng, S. Tripathi, and M. Dehmer, “An rainfall forecast, case study in eastern region of thailand,” Eng. Appl.
Introductory Review of Deep Learning for Prediction Models With Big
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.
Sci. Res., vol. 45, no. 3, pp. 203–211, 2018, doi: [51] S. Samsi, C. J. Mattioli, and M. S. Veillette, “Distributed deep learning
10.14456/easr.2018.24. for precipitation nowcasting,” arXiv, 2019.
[33] D. T. Anh, M. D. Bui, and P. Rutschmann, “A comparative study of [52] L. Tian, X. Li, Y. Ye, P. Xie, and Y. Li, “A Generative Adversarial
three different models to predict monthly rainfall in Ca Mau, Vietnam,” Gated Recurrent Unit Model for Precipitation Nowcasting,” IEEE
in Hydraulic engineering symposium Graz 2018. Water management - Geosci. Remote Sens. Lett., vol. 17, no. 4, pp. 601–605, 2019, doi:
innovation based on tradition, 2018, no. July, pp. 18–20. 10.1109/LGRS.2019.2926776.
[34] D. Kumar, A. Singh, P. Samui, and R. K. Jha, “Forecasting monthly [53] S. Agrawal, L. Barrington, C. Bromberg, J. Burge, C. Gazen, and J.
precipitation using sequential modelling,” Hydrol. Sci. J., vol. 64, no. Hickey, “Machine learning for precipitation nowcasting from radar
6, pp. 690–700, 2019, doi: 10.1080/02626667.2019.1595624. images,” arXiv, no. NeurIPS, pp. 1–6, 2019.
[35] Q. Miao, B. Pan, H. Wang, K. Hsu, and S. Sorooshian, “Improving [54] Q. K. Tran and S. K. Song, “Computer vision in precipitation
monsoon precipitation prediction using combined convolutional and nowcasting: Applying image quality assessment metrics for training
long short term memory neural network,” Water (Switzerland), vol. 11, deep neural networks,” Atmosphere (Basel)., vol. 10, no. 5, pp. 1–20,
no. 5, 2019, doi: 10.3390/w11050977. 2019, doi: 10.3390/atmos10050244.
[36] S. Viswanath, M. Saha, P. Mitra, and R. S. Nanjundiah, Deep Learning [55] changjiang zhang, H. Wang, J. Zeng, L. Ma, and L. Guan, “Tiny-
Based LSTM and SeqToSeq Models to Detect Monsoon Spells of India, RainNet: A Deep CNN-BiLSTM Model for Short-Term Rainfall
vol. 11537 LNCS. Springer International Publishing, 2019. Prediction,” Earth Sp. Sci. Open Arch., 2019, doi:
[37] M. H. Yen, D. W. Liu, Y. C. Hsin, C. E. Lin, and C. C. Chen, 10.1002/essoar.10501344.1.
“Application of the deep learning for the prediction of rainfall in [56] G. Ayzel, T. Scheffer, and M. Heistermann, “RainNet v1.0: A
Southern Taiwan,” Sci. Rep., vol. 9, no. 1, pp. 1–9, 2019, doi: convolutional neural network for radar-based precipitation
10.1038/s41598-019-49242-6. nowcasting,” Geosci. Model Dev., vol. 13, no. 6, pp. 2631–2644, 2020,
[38] F. Manokij, K. Sarinnapakorn, and P. Vateekul, “Forecasting doi: 10.5194/gmd-13-2631-2020.
Thailand’s Precipitation with Cascading Model of CNN and GRU,” [57] L. Chen, Y. Cao, L. Ma, and J. Zhang, “A Deep Learning-Based
Oct. 2019, doi: 10.1109/ICITEED.2019.8929975. Methodology for Precipitation Nowcasting With Radar,” Earth Sp.
[39] S. Poornima and M. Pushpalatha, “Prediction of rainfall using Sci., vol. 7, no. 2, 2020, doi: 10.1029/2019EA000812.
intensified LSTM based recurrent Neural Network with Weighted [58] Q. Yan, F. Ji, K. Miao, Q. Wu, Y. Xia, and T. Li, “Convolutional
Linear Units,” Atmosphere (Basel)., vol. 10, no. 11, 2019, doi: Residual-Attention: A Deep Learning Approach for Precipitation
10.3390/atmos10110668. Nowcasting,” Adv. Meteorol., vol. 2020, 2020, doi:
[40] L. Ni et al., “Streamflow and rainfall forecasting by two long short- 10.1155/2020/6484812.
term memory-based models,” J. Hydrol., vol. 583, p. 124296, 2019, [59] C. Kidd, V. Levizzani, J. Turk, and R. Ferraro, “Satellite precipitation
doi: 10.1016/j.jhydrol.2019.124296. measurements for water resource monitoring,” J. Am. Water Resour.
[41] C. J. Zhang, J. Zeng, H. Y. Wang, L. M. Ma, and H. Chu, “Correction Assoc., vol. 45, no. 3, pp. 567–579, 2009, doi: 10.1111/j.1752-
model for rainfall forecasts using the LSTM with multiple 1688.2009.00326.x.
meteorological factors,” Meteorol. Appl., vol. 27, no. 1, pp. 1–15, 2019, [60] Y. Tao, X. Gao, K. Hsu, S. Sorooshian, and A. Ihler, “A deep neural
doi: 10.1002/met.1852. network modeling framework to reduce bias in satellite precipitation
[42] K. Zhou, Y. Zheng, B. Li, W. Dong, and X. Zhang, “Forecasting products,” J. Hydrometeorol., vol. 17, no. 3, pp. 931–945, 2016, doi:
Different Types of Convective Weather: A Deep Learning Approach,” 10.1175/JHM-D-15-0075.1.
J. Meteorol. Res., vol. 33, no. 5, pp. 797–809, 2019, doi: [61] A. Akbari Asanjan, T. Yang, K. Hsu, S. Sorooshian, J. Lin, and Q.
10.1007/s13351-019-8162-6. Peng, “Short-Term Precipitation Forecast Based on the PERSIANN
[43] O. Manoj and J. P. Ananth, “MapReduce and Optimized Deep Network System and LSTM Recurrent Neural Networks,” J. Geophys. Res.
for Rainfall Prediction in Agriculture,” Comput. J., vol. 63, no. 6, pp. Atmos., vol. 123, no. 22, pp. 12,543-12,563, 2018, doi:
900–912, 2019, doi: 10.1093/comjnl/bxz164. 10.1029/2018JD028375.
[44] J. Pudashine et al., “Deep Learning for an Improved Prediction of [62] Y. M. Souto, F. Porto, A. M. Moura, and E. Bezerra, “A Spatiotemporal
Rainfall Retrievals From Commercial Microwave Links,” Water Ensemble Approach to Rainfall Forecasting,” in Proceedings of the
Resour. Res., vol. 56, no. 7, pp. 0–3, 2020, doi: International Joint Conference on Neural Networks, 2018, vol. 2018-
10.1029/2019WR026255. July, pp. 1–8, doi: 10.1109/IJCNN.2018.8489693.
[45] P. Hewage, M. Trovati, E. Pereira, and A. Behera, “Deep learning- [63] R. Sato, H. Kashima, and T. Yamamoto, Short-term precipitation
based effective fine-grained weather forecasting model,” Pattern Anal. prediction with skip-connected PredNet, vol. 11141 LNCS. Springer
Appl., no. 0123456789, 2020, doi: 10.1007/s10044-020-00898-1. International Publishing, 2018.
[46] X. Shi, Z. Chen, H. Wang, D. Y. Yeung, W. K. Wong, and W. C. Woo, [64] H. Wu, Q. Yang, J. Liu, and G. Wang, “A spatiotemporal deep fusion
“Convolutional LSTM network: A machine learning approach for model for merging satellite and gauge precipitation in China,” J.
precipitation nowcasting,” Adv. Neural Inf. Process. Syst., vol. 2015- Hydrol., vol. 584, no. 2006, p. 124664, 2020, doi:
Janua, no. June, pp. 802–810, 2015. 10.1016/j.jhydrol.2020.124664.
[47] A. Heye, K. Venkatesan, and J. Cain, “Precipitation Nowcasting: [65] A. Kumar, T. Islam, Y. Sekimoto, C. Mattmann, and B. Wilson,
Leveraging Deep Recurrent Convolutional Neural Networks,” 2017, “ConvCast: An embedded convolutional LSTM based architecture for
[Online]. Available: precipitation nowcasting using satellite data,” PLoS One, vol. 15, no.
https://cug.org/proceedings/cug2017_proceedings/includes/files/pap1 3, pp. 1–18, 2020, doi: 10.1371/journal.pone.0230114.
55s2-file1.pdf. [66] M. Saha, P. Mitra, and R. S. Nanjundiah, “Predictor discovery for
[48] X. Shi et al., “Deep learning for precipitation nowcasting: A early-late Indian Summer Monsoon using stacked autoencoder,”
benchmark and a new model,” arXiv, no. Nips, pp. 1–11, 2017. Procedia Comput. Sci., vol. 80, pp. 565–576, 2016, doi:
10.1016/j.procs.2016.05.337.
[49] S. Singh, S. Sarkar, and P. Mitra, “Leveraging convolutions in
recurrent neural networks for doppler weather radar echo prediction,” [67] F. Manokij, K. Sarinnapakorn, and P. Vateekul, “Forecasting
Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Thailand’s Precipitation with Cascading Model of CNN and GRU,” in
Lect. Notes Bioinformatics), vol. 10262 LNCS, pp. 310–317, 2017, doi: 2019 11th International Conference on Information Technology and
10.1007/978-3-319-59081-3_37. Electrical Engineering (ICITEE), Pattaya, Thailand, 2019, 2019, pp.
1–6, doi: 10.1109/ICITEED.2019.8929975.
[50] S. Kim, S. Hong, M. Joh, and S. K. Song, “DeepRain: ConvLSTM
network for precipitation prediction using multichannel radar data,”
arXiv, pp. 3–6, 2017.
Authorized licensed use limited to: NIELIT Aizawl. Downloaded on September 27,2023 at 07:15:47 UTC from IEEE Xplore. Restrictions apply.