Enhancing Rainfall Data Consistency and Completeness: A Spatiotemporal Quality Control Approach and Missing Data Reconstruction Using MICE on Large Precipitation Datasets

Nafiseh Seyyed Nezhad Golkhatmi () and Mahboobeh Farzandi
Additional contact information
Nafiseh Seyyed Nezhad Golkhatmi: Ferdowsi University of Mashhad
Mahboobeh Farzandi: Ferdowsi University of Mashhad

Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), 2024, vol. 38, issue 3, No 1, 815-833

Abstract: Abstract Accurate and complete data are crucial for climate, environmental, water, and agricultural research. Any record of data that is contaminated with errors should be considered missing and reconstructed. Pollution in climate data can lead to systematic errors, such as polluted outlier data. Simply removing outlier data is not a reliable method, and it is important to perform quality control checks to determine the reliability of the data. While methods for detecting outlier data have received significant attention from researchers, less investigation has been conducted on determining the pollution of outlier data. We propose methods for quality control and reconstruction of incomplete rainfall data using data from 141 stations in the Qaraqhum basin in northeastern Iran. We performed checks for gross errors, temporal consistency, and outlier data. As we observed that the probability distribution of monthly precipitation had a skewness shape, we utilized a robust 3σ-rule to detect outlier values. We propose the use of information such as the number of daily precipitation events per month, maximum monthly rainfall, and standardized monthly rainfall (based on robust 3σ-rule) to detect pollution of outlier values. Additionally, we performed a spatial–temporal comparison to determine the difference between no record and no occurrence of precipitation. For data reconstruction, we used the "mice" package in R, which imputes data using chain equations. We investigated the performance of five functions available in the mice package, and the results showed that the "norm.nob" method had the best performance, while the "sample" and "mean" methods had the weakest performance. Graphical Abstract

Keywords: Spatiotemporal quality control; Polluted outlier data detection; Multiple imputation by chained equations (MICE) package; Shiny package (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11269-023-03567-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:waterr:v:38:y:2024:i:3:d:10.1007_s11269-023-03567-0

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11269

DOI: 10.1007/s11269-023-03567-0

Access Statistics for this article

Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA) is currently edited by G. Tsakiris

More articles in Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA) from Springer, European Water Resources Association (EWRA)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().