EconPapers    
Economics at your fingertips  
 

Variable Selection in High Dimensional Linear Regressions with Parameter Instability

Alexander Chudik, Mohammad Pesaran and Mahrad Sharifvaghefi

Papers from arXiv.org

Abstract: This paper is concerned with the problem of variable selection in the presence of parameter instability when both the marginal effects of signals on the target variable and the correlations of the covariates in the active set could vary over time. We pose the issue of whether one should use weighted or unweighted observations at the variable selection stage in the presence of parameter instability, particularly when the number of potential covariates is large. We allow parameter instability to be continuous or discrete, subject to certain regularity conditions. We discuss the pros and cons of Lasso and the One Covariate at a time Multiple Testing (OCMT) method for variable selection and argue that OCMT has important advantages under parameter instability. We establish three main theorems on selection, estimation post selection, and in-sample fit. These theorems provide justification for using unweighted observations at the selection stage of OCMT and down-weighting of observations only at the forecasting stage. It is shown that OCMT delivers better forecasts, in mean squared error sense, as compared to Lasso, Adaptive Lasso and boosting both in Monte Carlo experiments as well as in 3 sets of empirical applications: forecasting monthly returns on 28 stocks from Dow Jones , forecasting quarterly output growths across 33 countries, and forecasting euro area output growth using surveys of professional forecasters.

Date: 2023-12
New Economics Papers: this item is included in nep-for
References: Add references at CitEc
Citations:

Downloads: (external link)
http://arxiv.org/pdf/2312.15494 Latest version (application/pdf)

Related works:
Working Paper: Variable Selection in High Dimensional Linear Regressions with Parameter Instability (2023) Downloads
Working Paper: Variable Selection in High Dimensional Linear Regressions with Parameter Instability (2023) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:arx:papers:2312.15494

Access Statistics for this paper

More papers in Papers from arXiv.org
Bibliographic data for series maintained by arXiv administrators ().

 
Page updated 2024-05-06
Handle: RePEc:arx:papers:2312.15494