pith. machine review for the scientific record. sign in

arxiv: 2411.07874 · v2 · submitted 2024-11-12 · 📊 stat.ME · math.ST· stat.TH

Recognition: unknown

Changepoint Detection in Complex Models: Cross-Fitting Is Needed

Authors on Pith no claims yet
classification 📊 stat.ME math.STstat.TH
keywords changepointdetectioncomplexcross-fittingestimationmodelmodelsaccuracy
0
0 comments X
read the original abstract

Changepoint detection is commonly formulated by minimizing the sum of in-sample losses to quantify the model's overall fit. However, for flexible modeling procedures -- especially those involving high-dimensional parameter spaces or hyperparameter tuning -- this strategy can lead to inaccurate changepoint estimation due to over-adaptivity biases. To mitigate this issue, we propose a novel cross-fitting methodology based on out-of-sample loss evaluations, which decouples model fitting from changepoint search. We establish a general theoretical framework for consistent changepoint estimation under mild conditions, and further extend it to temporally dependent data. A key implication of the theory is that consistency depends primarily on the models' predictive accuracy over nearly homogeneous segments. Numerical experiments show that the proposed method substantially improves the reliability and adaptability of changepoint detection in complex scenarios.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.