High dimensional change point estimation via sparse projection

Tengyao Wang and Richard J. Samworth

Journal of the Royal Statistical Society Series B, 2018, vol. 80, issue 1, 57-83

Abstract: Change points are a very common feature of ‘big data’ that arrive in the form of a data stream. We study high dimensional time series in which, at certain time points, the mean structure changes in a sparse subset of the co‐ordinates. The challenge is to borrow strength across the co‐ordinates to detect smaller changes than could be observed in any individual component series. We propose a two‐stage procedure called inspect for estimation of the change points: first, we argue that a good projection direction can be obtained as the leading left singular vector of the matrix that solves a convex optimization problem derived from the cumulative sum transformation of the time series. We then apply an existing univariate change point estimation algorithm to the projected series. Our theory provides strong guarantees on both the number of estimated change points and the rates of convergence of their locations, and our numerical studies validate its highly competitive empirical performance for a wide range of data‐generating mechanisms. Software implementing the methodology is available in the R package InspectChangepoint.

Date: 2018
References: Add references at CitEc
Citations: View citations in EconPapers (33)

Downloads: (external link)
https://doi.org/10.1111/rssb.12243

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:80:y:2018:i:1:p:57-83

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().