Selective inference after feature selection via multiscale bootstrap

Yoshikazu Terada () and Hidetoshi Shimodaira ()
Additional contact information
Yoshikazu Terada: Osaka University
Hidetoshi Shimodaira: Kyoto University

Annals of the Institute of Statistical Mathematics, 2023, vol. 75, issue 1, No 5, 99-125

Abstract: Abstract It is common to show the confidence intervals or p-values of selected features, or predictor variables in regression, but they often involve selection bias. The selective inference approach solves this bias by conditioning on the selection event. Most existing studies of selective inference consider a specific algorithm, such as Lasso, for feature selection, and thus they have difficulties in handling more complicated algorithms. Moreover, existing studies often consider unnecessarily restrictive events, leading to over-conditioning and lower statistical power. Our novel and widely applicable resampling method via multiscale bootstrap addresses these issues to compute an approximately unbiased selective p-value for the selected features. As a simplification of the proposed method, we also develop a simpler method via the classical bootstrap. We prove that the p-value computed by our multiscale bootstrap method is more accurate than the classical bootstrap method. Furthermore, numerical experiments demonstrate that our algorithm works well even for more complicated feature selection methods such as non-convex regularization.

Keywords: Hypothesis testing; Confidence intervals; Variable selection; Bootstrap resampling; Selective inference (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s10463-022-00838-2 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:aistmt:v:75:y:2023:i:1:d:10.1007_s10463-022-00838-2

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10463/PS2

DOI: 10.1007/s10463-022-00838-2

Access Statistics for this article

Annals of the Institute of Statistical Mathematics is currently edited by Tomoyuki Higuchi

More articles in Annals of the Institute of Statistical Mathematics from Springer, The Institute of Statistical Mathematics
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().