Sequential estimate for linear regression models with uncertain number of effective variables

Zhanfeng Wang () and Yuan-chin Chang ()

Metrika: International Journal for Theoretical and Applied Statistics, 2013, vol. 76, issue 7, 949-978

Abstract: As a result of novel data collection technologies, it is now common to encounter data in which the number of explanatory variables collected is large, while the number of variables that actually contribute to the model remains small. Thus, a method that can identify those variables with impact on the model without inferring other noneffective ones will make analysis much more efficient. Many methods are proposed to resolve the model selection problems under such circumstances, however, it is still unknown how large a sample size is sufficient to identify those “effective” variables. In this paper, we apply sequential sampling method so that the effective variables can be identified efficiently, and the sampling is stopped as soon as the “effective” variables are identified and their corresponding regression coefficients are estimated with satisfactory accuracy, which is new to sequential estimation. Both fixed and adaptive designs are considered. The asymptotic properties of estimates of the number of effective variables and their coefficients are established, and the proposed sequential estimation procedure is shown to be asymptotically optimal. Simulation studies are conducted to illustrate the performance of the proposed estimation method, and a diabetes data set is used as an example. Copyright Springer-Verlag Berlin Heidelberg 2013

Keywords: Confidence set; Shrinkage estimation; Stochastic regression; Stopping time (search for similar items in EconPapers)
Date: 2013
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1007/s00184-012-0426-4 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metrik:v:76:y:2013:i:7:p:949-978

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/184/PS2

DOI: 10.1007/s00184-012-0426-4

Access Statistics for this article

Metrika: International Journal for Theoretical and Applied Statistics is currently edited by U. Kamps and Norbert Henze

More articles in Metrika: International Journal for Theoretical and Applied Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().