Effect of Gradient Descent Optimizers and Dropout Technique on Deep Learning LSTM Performance in Rainfall-runoff Modeling

Duong Tran Anh, Dat Vi Thanh, Hoang Minh Le, Bang Tran Sy, Ahad Hasan Tanim, Quoc Bao Pham, Thanh Duc Dang, Son T. Mai and Nguyen Mai Dang ()
Additional contact information
Duong Tran Anh: Van Lang University
Dat Vi Thanh: Hanoi University of Science and Technology, Hai Ba Trung District
Hoang Minh Le: York University
Bang Tran Sy: University of Nevada
Ahad Hasan Tanim: University of South Carolina
Quoc Bao Pham: Thu Dau Mot University
Thanh Duc Dang: Thuyloi University
Son T. Mai: Queen’s University Belfast
Nguyen Mai Dang: Thuyloi University

Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), 2023, vol. 37, issue 2, No 4, 639-657

Abstract: Abstract Machine learning and deep learning (ML-DL) based models are widely used for rainfall-runoff prediction and they have potential to substitute process-oriented physics based numerical models. However, developing an ML model has also performance uncertainty because of inaccurate choices of hyperparameters and neural networks architectures. Thus, this study aims to search for best optimization algorithms to be used in ML-DL models namely, RMSprop, Adagrad, Adadelta, and Adam optimizers, as well as dropout techniques to be integrated into the Long Short Term Memory (LSTM) model to improve forecasting accuracy of rainfall-runoff modeling. A deep learning LSTMs were developed using 480 model architectures at two hydro-meteorological stations of the Mekong Delta, Vietnam, namely Chau Doc and Can Tho. The model performance is tested with the most ideally suited LSTM optimizers utilizing combinations of four dropout percentages respectively, 0%, 10%, 20%, and 30%. The Adagrad optimizer shows the best model performance in the model testing. Deep learning LSTM models with 10% dropout made the best prediction results while significantly reducing overfitting tendency of the forecasted time series. The findings of this study are valuable for ML-based hydrological models set up by identifying a suitable gradient descent (GD) optimizer and optimal dropout ratio to enhance the performance and forecasting accuracy of the ML model.

Keywords: Optimizers; Dropout technique; LSTM; Rainfall-runoff; Mekong delta (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s11269-022-03393-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:waterr:v:37:y:2023:i:2:d:10.1007_s11269-022-03393-w

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11269

DOI: 10.1007/s11269-022-03393-w

Access Statistics for this article

Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA) is currently edited by G. Tsakiris

More articles in Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA) from Springer, European Water Resources Association (EWRA)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().