{"id":"13d757f9-c1da-4a07-b211-dfb41a2a67b9","arxiv_id":"2412.08192","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"Flare-biased interpolation biases periodogram fits in AGN variability studies, and the EMP13 simulation algorithm is often misused so that phase information and red-noise-leak correction are lost.","lead":"This paper simulates AGN light curves to test common methods for finding variability timescales and exposes two overlooked errors: interpolating flare-biased data distorts power spectra differently than simulations predict, and a widely used simulation algorithm is frequently run in a way that destroys red-noise-leak correction. It serves as a warning that some published variability timescales and power-spectrum slopes may be biased by method misuse.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The flare-bias finding rests on a single observed periodogram compared to a simulation mean, with no error bars or ensemble scatter; the claimed systematic difference is not yet established.","rationale":"The reader's weakest assumption was that real monitoring data are not demonstrably flare-biased; that is a valid concern about the practical impact of the result. However, the more load-bearing problem is internal to the demonstration: even with simulated flare-biased sampling, the evidence in Fig. 3 is a single periodogram versus a simulation mean, with no quantification of scatter. If that comparison is not statistically significant, the central new claim fails regardless of how common flare bias is in real data. The paper's literature review, the red-noise leak and aliasing discussion, and the EMP13 phase-randomisation caveat are useful and largely consistent with prior work; the issue is specifically the headline result. The reader's conditional verdict already requires stronger support, so the verdict should remain conditional. The concrete ensemble comparison above would settle whether the apparent effect is real or a fluctuation.","tokens_in":19497,"tokens_out":5904,"duration_ms":68245,"concrete_test":"Repeat the Fig. 3 experiment with two ensembles: (i) 1000 flare-biased realisations generated with the same construction rule, and (ii) 1000 independent realisations with the same replicated time stamps but no flare-sampling correlation. For each realisation compute the binned periodogram and measure the high-frequency slope; report the median and 90% scatter of the slope difference between ensembles and run a two-sample test (e.g. bootstrap or Kolmogorov-Smirnov) on the slopes or binned periodogram values. If the distributions overlap substantially, the claimed systematic mis-estimate is not established.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central new claim (Abstract; Sect. 4.1.1, Fig. 3) is supported by comparing the black periodogram of one flare-biased light curve with the purple mean periodogram of 1000 simulated light curves that use replicated sampling. Red-noise periodograms have very large realisation-to-realisation scatter, so a visual separation between a single draw and a smooth mean does not demonstrate a systematic effect. Without error bars on the purple mean, or better the distribution of single-realisation periodograms under the null hypothesis that sampling times are independent of flare state, the apparent steepening difference could be a fluctuation. The construction of the flare-biased sampling is also described only qualitatively ('dividing the time stamps of flux densities into two arrays based on their values'), with no released code or exact algorithm, and the interpolation scheme is not specified. If the black periodogram falls within the null ensemble scatter, the abstract's claim fails even for simulated data, independently of whether real monitoring campaigns actually exhibit flare-biased sampling.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents a practical review of statistical caveats in AGN variability analysis, supported by simulations. It reproduces known issues (red-noise leak, aliasing, interpolation effects, structure function biases) and claims two previously overlooked caveats: (1) interpolation of light curves whose sampling is biased toward flaring states affects the measured PSD differently than applying the same sampling times to independent simulated light curves, thereby biasing PSRESP-style fits; and (2) the EMP13 surrogate algorithm is often misused when the light curve is cut to a shorter segment before the iterative step, because this randomizes phase information and prevents windowing from correcting red-noise leak. The paper also discusses periodogram normalisation, timescale estimation, and quasiperiodicity detection, and it summarises lessons learned from the authors' companion Paper I.","tokens_in":19679,"tokens_out":4675,"duration_ms":46673,"significance":"If the flare-bias claim holds, it would affect a broad class of PSD fitting studies of AGN light curves, particularly in radio monitoring where sampling density may correlate with flaring activity. The EMP13 caveat is a useful practical warning for surrogate-data users. The paper is valuable as a consolidated review with simulation-based demonstrations, and the authors are appropriately cautious about some limitations of their own tests. However, the statistical evidence for the main new claim is currently insufficient, so the central novelty is not yet established.","major_comments":[{"comment":"The central claim that flare-biased sampling changes the effect of interpolation on the PSD is supported only by a visual comparison between a single periodogram (black) and the mean of 1000 simulated periodograms (purple), with no error bars, quantile ranges, or significance test. Because red-noise periodograms have large realization-to-realization scatter, the apparent difference could be a fluctuation. Please provide the distribution of the simulated periodograms (e.g., 5–95% percentiles) or, ideally, the distribution of single-realization periodograms under the null hypothesis that the sampling times are independent of the flux values, and state explicitly whether the observed black periodogram lies outside that null distribution.","section":"§4.1.1, Fig. 3"},{"comment":"The construction of the flare-biased sampling is described only qualitatively ('dividing the time stamps of flux densities into two arrays based on their values'), which makes it impossible to reproduce or assess the magnitude of the bias. Please specify the exact algorithm, including the selection rule, the density contrast between flaring and non-flaring states, the interpolation scheme used, and the parameter values for the simulation shown in Fig. 3. Without this, the generality of the claimed effect cannot be evaluated.","section":"§4.1.1"},{"comment":"The paper notes that the MRO light curves have 'much less prominent' flare bias but never defines or measures flare bias in real data. To make the practical claim actionable, the authors should propose a quantitative metric for the correlation between sampling density and flux level, report it for the simulations, and, if possible, for the MRO data. Otherwise the relevance of the effect to actual AGN monitoring campaigns remains speculative.","section":"§4.1.1 and §7"},{"comment":"The claim that cutting the TK95 light curve before the EMP13 iterative step randomizes phase and hence disables windowing-based red-noise-leak correction is demonstrated only by example light curves and periodograms. Please add a quantitative comparison across multiple realisations (e.g., mean and scatter of measured PSD slopes with and without phase preservation) and state the range of β for which the effect is significant. As written, the reader cannot tell whether the effect is large enough to affect typical AGN analyses.","section":"§5.4.2, Figs. 11–12"}],"minor_comments":[{"comment":"Please define ΔPsim(ν) explicitly; from the text it is presumably the standard deviation of the simulated periodograms, but the notation is ambiguous.","section":"§5.1, Eq. (8)"},{"comment":"The comparison of normalisation schemes is based on one example; it would be helpful to state over how many simulations the 'closer' agreement was assessed.","section":"§4.1.2, Fig. 5"},{"comment":"The statement that TK95 variance does not depend on N is imprecise; the variance of the simulated series does depend on the number of points through the normalization of the Fourier components. Please clarify the intended meaning, particularly in relation to the red-noise-leak simulation lengths.","section":"§5.4.1"},{"comment":"The correlation between β and the bend timescale is shown visually but not quantified; a simple measure of overlap of the periodogram distributions or a summary statistic would strengthen the claim.","section":"§6.1, Fig. 13"}],"recommendation":"major_revision","confidential_remarks":"The paper is a companion to Paper I and draws on the authors' own previous analysis. The flare-bias claim is the primary new result and, as detailed in the major comments, needs stronger statistical support and a more precise algorithmic description. The EMP13 phase-randomisation issue is framed for an astronomy audience but is related to known surrogate-data literature; the quantitative assessment will help establish its practical importance. The manuscript is within scope for A&A. I encourage the authors to release the simulation code with the revised version to make the demonstrations reproducible."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Here's the short version: this is a practical caveats paper from the Metsähovi group, a companion to their Paper I periodogram analysis. The genuinely new items are (1) flare-biased sampling changes the periodogram of an observed light curve differently than the same time stamps applied to independent simulations, and (2) running the EMP13 iterative step after cutting the light curve to the observed length randomizes phases and defeats windowing. The second point is clearly right, though EMP13 themselves said phase information is lost when cutting; the paper's contribution is showing what that does in practice. The first point is plausible but not yet demonstrated at the level the abstract claims.\n\nWhat the paper does well: the review of known pitfalls (red-noise leak, aliasing, windowing, structure-function timescale offsets, PSRESP) is careful and genuinely useful. The authors are honest about limitations: they note the EMP13 caveat appears in the original paper, and they state that their real MRO light curves have much less flare bias than the simulations. The figures explaining red-noise leak via sine-wave discontinuities are the clearest I've seen.\n\nWhere it's soft: the flare-bias finding in Fig. 3 rests on comparing one black periodogram from a single flare-biased light curve to the purple mean of 1000 simulated periodograms, with no error bars or ensemble scatter. Red-noise periodograms have enormous realization-to-realization scatter, so a single draw sitting above a smooth mean does not establish a systematic effect. The construction of the flare-biased sampling is described qualitatively with no code or exact algorithm, so the strength and generality of the effect is unknown. The paper's own statement that MRO data are much less flare-biased further limits the practical stakes. These are fixable with better simulations and a null ensemble, but right now the headline claim is under-supported.\n\nThe EMP13 section is on firmer ground; the demonstration that windowing fails after phase randomization is a useful warning, especially for steep PSD slopes (beta > 2).\n\nWho should read this: anyone fitting PSDs to unevenly sampled AGN light curves, particularly at radio wavelengths. The review sections are worth having as a reference. I would not yet cite the flare-bias claim as established, but I would cite the paper for the caveats compilation.\n\nRecommendation: send to peer review. A serious referee can ask for error bars and a null ensemble for Fig. 3, a precise description of the flare-bias sampling, and some quantification of flare-bias in real campaigns. With those, it becomes a solid methods paper.","headline":"Useful caveats review with two simulation-based findings, but the flare-bias claim needs error bars and a null ensemble before it carries weight.","tokens_in":20195,"tokens_out":2845,"would_cite":true,"duration_ms":30010,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Flare-biased sampling distorts the power spectra of AGN light curves, and standard simulations that reuse the observed time stamps cannot reproduce the distortion.","keywords":["galaxies: active","quasars: general","methods: data analysis","power spectral density","periodogram","red-noise leak","light-curve simulations","surrogate data"],"falsifier":"Measure the correlation between observing-cadence density and flux density in a monitoring data set, then compare the observed periodogram with the PSRESP-simulated mean periodogram: if a source with strong flare-biased sampling shows no systematic offset, or if a source with zero sampling-flux correlation still shows the mismatch, the flare-bias explanation would be wrong. A simpler simulation check is to generate a light curve with a known PSD, apply a deliberately flare-biased sampling pattern, and verify the predicted sign and size of the offset; removing the flare-sampling correlation should make the offset disappear.","tokens_in":19277,"feed_emoji":"📈","tokens_out":9091,"duration_ms":86960,"temperature":0.7,"pith_summary":"The paper argues that common statistical tools for measuring AGN variability timescales have hidden failure modes, and demonstrates two with simulations. First, when a monitoring campaign observes more densely during flaring states, interpolating the unevenly sampled light curve changes its measured power spectral density in a way that standard PSRESP-style simulations do not capture: simulated light curves that reuse the observed time stamps have flares at random times, so interpolation smooths them more than it smooths the real flare-biased light curve. Second, the popular EMP13 algorithm for generating light curves with a given probability distribution is often misused by cutting the simulated series short before the iterative step, which randomizes phase information, ruins the red-noise-leak correction, and flattens periodograms of steep-spectrum sources. If these findings hold, previously reported PSD slopes, bend timescales, and quasiperiodicity claims from such analyses may contain a systematic bias that error bars do not reflect.","feed_headline":"Flare-triggered sampling skews measured AGN power spectra","feed_subtitle":"Reusing observed timestamps in simulations misses the bias, so inferred variability timescales can be wrong.","key_machinery":"The load-bearing object is the periodogram computed after linear interpolation of an unevenly sampled light curve, together with the PSRESP simulation procedure that copies the observed time stamps onto simulated light curves, and the EMP13/IAAFT surrogate-data iteration that is supposed to match a specified probability density function. Interpolation smooths over gaps, reducing high-frequency power and steepening the periodogram; the paper's simulations show that when dense sampling is aligned with flares, this steepening is partly cancelled because the flares themselves are well resolved, whereas randomly placed dense-sampling windows in simulations are not. The EMP13 algorithm's iterative step also acts as a phase-randomising operation, and the paper shows that cutting the simulated series before that step mixes the red-noise leak into the periodogram in a way that windowing cannot undo.","core_discovery":"The central discovery is a mismatch between observed and simulated periodograms that traces to the correlation between sampling density and source brightness. In the PSRESP method, the observed sampling pattern is copied onto simulated light curves so that sampling artefacts appear in both, and the goodness of fit is judged by comparing the observed periodogram with the simulated mean periodogram. The authors simulate a flare-biased observing pattern and find that the real flare-biased light curve, after interpolation, yields a periodogram that is steeper than the evenly sampled case but not as steep as the mean periodogram of simulations carrying the same time stamps. The reason is that in the simulations the dense-sampling windows fall randomly with respect to flares, whereas in the actual flare-biased light curve they preferentially fall on the flares, suppressing the smoothing effect of interpolation. The same mechanism, the paper argues, can make a single observed light curve look significantly different from its own simulations even when the underlying PSD model is correct. The paper's second discovery is that the EMP13 surrogate algorithm loses phase information when its long initial simulation is cut to the observing-window length before the iterative step, which prevents Hann-window or end-matching corrections from removing red-noise leak and flattens the periodogram for steep PSD slopes.","pith_inferences":["The flare-bias mechanism should apply to any stochastic astronomical source observed with a target-of-opportunity or alert-driven cadence, not just AGNs; X-ray and gamma-ray transients and microlensing events could show the same observed-versus-simulated periodogram mismatch.","A direct empirical test would be to measure the cross-correlation between observing density and flux state in a real monitoring data set and check whether the observed-minus-simulated periodogram offset scales with that correlation.","Papers that report bend timescales from PSRESP on sparsely sampled radio light curves may need re-analysis with flare-bias-aware simulations; the authors note their own radio data has much less prominent flare bias, so the effect may be most relevant to X-ray and optical campaigns with flare-triggered follow-up.","The EMP13 phase-randomization issue suggests that published surrogate-based significance estimates for quasiperiodicities, especially for steep PSD slopes, could shift if the full-length iterative step is used; re-running such analyses would be a cheap check."],"forward_implications":["For sources whose monitoring cadence is correlated with flaring, PSRESP model fits will systematically compare the observed periodogram to a simulation ensemble that is biased in the opposite direction, so inferred PSD slopes and bend timescales carry an error not captured by the fit's scatter.","A large parameter space of good fits is to be expected in sparsely sampled periodogram fitting; slope and characteristic timescale are strongly correlated and cannot be pinned down from such data.","The EMP13 shortcut of cutting the light curve before the iterative step flattens periodograms of steep-spectrum sources, making it impossible to put reliable upper limits on PSD slopes when windowing is used.","The Hann window and end-matching correct red-noise leak only when phase information is preserved; quasiperiodicity searches that use windowing on phase-randomised surrogates can produce false detections or false non-detections.","The Lomb-Scargle false-alarm probability applies only to white noise and should not be used to claim quasiperiodicities in red-noise AGN data."],"supporting_citations":[{"why":"Defines the PSRESP method whose observed-sampling replication is the target of the flare-bias critique.","marker":"Uttley et al. (2002)"},{"why":"Supplies the TK95 Fourier-synthesis algorithm used for the simulated light curves in the periodogram tests.","marker":"Timmer & Koenig (1995)"},{"why":"Introduces the EMP13 surrogate algorithm whose phase-randomization misuse is exposed.","marker":"Emmanoulopoulos et al. (2013)"},{"why":"Provides the IAAFT surrogate method and the end-matching correction that the EMP13 misuse undermines.","marker":"Schreiber & Schmitz (2000)"},{"why":"Documents the PDF-versus-PSD tradeoff in IAAFT iteration that the paper cites for surrogate limitations.","marker":"Maiwald et al. (2008)"},{"why":"Shows TK95 simulated light curves become less Gaussian for steeper PSD slopes, a caveat the paper confirms.","marker":"Morris et al. (2019)"},{"why":"Supplies the standard periodogram and red-noise analysis caveats and stationarity discussion the paper builds on.","marker":"Vaughan et al. (2003)"},{"why":"Introduces the Lomb-Scargle false-alarm probability whose white-noise-only validity the paper stresses.","marker":"Scargle (1982)"},{"why":"Catalogs Lomb-Scargle misconceptions including aliasing, supporting the paper's caution.","marker":"VanderPlas 2018"},{"why":"Discusses flicker noise, PSD shapes, and characteristic bend frequencies used throughout the timescale discussion.","marker":"Press (1978)"}],"fun_headline_variants":["Flare-biased sampling warps AGN variability timescales","Sampling bias mimics steeper AGN power spectra","AGN light curves: sampling bias distorts PSD fits","Interpolation and sampling: hidden AGN analysis traps"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The claim depends on real monitoring campaigns being genuinely denser during flaring states, coupled with the absence of that coupling in simulations that merely reuse the time stamps; the paper illustrates the effect with simulated flare-biased sampling and notes that its own radio data shows much less prominent flare bias, but does not measure the correlation's strength in actual AGN data.","fun_headline_variants_meta":{"raw":{"variants":["Flare-biased sampling warps AGN variability timescales","Sampling bias mimics steeper AGN power spectra","AGN light curves: sampling bias distorts PSD fits","Interpolation and sampling: hidden AGN analysis traps"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000273,"raw_usage":{"total_tokens":1661,"prompt_tokens":999,"completion_tokens":662,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":615,"completion_tokens_details":{"reasoning_tokens":594}},"tokens_in":615,"tokens_out":662,"duration_ms":6596,"temperature":1.0,"reasoning_tokens":594,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-11T18:06:46.157589+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Measure the correlation between observing-cadence density and flux density in a monitoring data set, then compare the observed periodogram with the PSRESP-simulated mean periodogram: if a source with strong flare-biased sampling shows no systematic offset, or if a source with zero sampling-flux correlation still shows the mismatch, the flare-bias explanation would be wrong. A simpler simulation check is to generate a light curve with a known PSD, apply a deliberately flare-biased sampling pattern, and verify the predicted sign and size of the offset; removing the flare-sampling correlation should make the offset disappear.","supporting_citations":[{"cited_title":"& Koenig, M","cited_arxiv_id":null,"evidence_quote":"Supplies the TK95 Fourier-synthesis algorithm used for the simulated light curves in the periodogram tests."},{"cited_title":"2013, MNRAS, 433, 907","cited_arxiv_id":null,"evidence_quote":"Introduces the EMP13 surrogate algorithm whose phase-randomization misuse is exposed."},{"cited_title":"& Schmitz, A","cited_arxiv_id":null,"evidence_quote":"Provides the IAAFT surrogate method and the end-matching correction that the EMP13 misuse undermines."},{"cited_title":"2008, Surrogate Data - A Qualitative and Quantitative Analysis, ed","cited_arxiv_id":null,"evidence_quote":"Documents the PDF-versus-PSD tradeoff in IAAFT iteration that the paper cites for surrogate limitations."},{"cited_title":"J., Chakraborty, N., & Cotter, G","cited_arxiv_id":null,"evidence_quote":"Shows TK95 simulated light curves become less Gaussian for steeper PSD slopes, a caveat the paper confirms."},{"cited_title":"2003, MNRAS, 345, 1271","cited_arxiv_id":null,"evidence_quote":"Supplies the standard periodogram and red-noise analysis caveats and stationarity discussion the paper builds on."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Introduces the Lomb-Scargle false-alarm probability whose white-noise-only validity the paper stresses."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Discusses flicker noise, PSD shapes, and characteristic bend frequencies used throughout the timescale discussion."}],"review_version":1}