An Approach for Specifying Trimming and Winsorization Cutoffs

Kedai Cheng () and Derek S. Young ()
Additional contact information
Kedai Cheng: University of North Carolina - Asheville
Derek S. Young: University of Kentucky

Journal of Agricultural, Biological and Environmental Statistics, 2023, vol. 28, issue 2, No 6, 299-323

Abstract: Abstract Outliers and extreme values are common in the era of big data, especially in the collection of survey data and real analysis. Clearly, care needs to be taken with how such values are treated in the calculation of statistical summaries, such as those involving the sample mean and sample variance. Robust alternatives based on trimming or Winsorization are often employed to mitigate the effect of those outlying points. An aspect critical to these methods, however, is in the determination of the cutoff locations. One classic approach is g-and-g-times trimming/Winsorization, which takes a proportion g off from both tails. However, this method does not carry any confidence statement, such as one finds with the calculation of statistical intervals. We propose the application of nonparametric statistical tolerance intervals, which captures a specified proportion of the sampled population at a confidence level, to determine cutoff locations for trimming and Winsorization. Extensive simulation studies show that this approach yields better coverage than the g-and-g-times method, even though the latter was not designed as a confidence procedure. Census of Agriculture data since 1982 is analyzed to highlight the impact on statistical summaries regarding farm land. Supplementary materials accompanying this paper appear online.

Keywords: Convex hull; Data depth; Influence function; Order statistics; Survey analysis; Tolerance limits (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s13253-023-00527-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jagbes:v:28:y:2023:i:2:d:10.1007_s13253-023-00527-4

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/13253

DOI: 10.1007/s13253-023-00527-4

Access Statistics for this article

Journal of Agricultural, Biological and Environmental Statistics is currently edited by Stephen Buckland

More articles in Journal of Agricultural, Biological and Environmental Statistics from Springer, The International Biometric Society, American Statistical Association
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().