{"id":"9d5bac45-00b9-49a8-8ba9-91f2869de3de","arxiv_id":"1908.01692","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":4,"one_line_summary":"Miscalibrated horizontal shifts in HST/WFC3 spatial scan data can create spurious molecular detections in exoplanet transmission spectra, so such shifts must be measured to better than 1% of a pixel.","lead":"This paper uses simulated Hubble Space Telescope observations to check whether instrument quirks can distort the measured atmospheres of two exoplanets. It finds that small shifts in the spectrum on the detector can create fake chemical signals, including molecules that are not really there.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The claimed false HCN/NH3 detections are asserted without detection significance, so the headline horizontal-shift warning is not yet quantitatively supported.","rationale":"The reader's CONDITIONAL verdict and moderate confidence are appropriate. My stress-test pass focused on the central quantitative claim: a ~0.025-pixel horizontal-shift error leads to spurious HCN/NH3 detections. The paper shows the biased spectral trend and the T-REx fit, but never quantifies how strongly the extra molecules are required. Without a significance metric, the apparent false detection may be a retrieval artifact with negligible abundance. A T-REx retrieval with and without HCN/NH3 would settle this. If the molecules are insignificant, the paper still shows a spectral bias, but the dramatic 'false molecular detection' framing and the 'most important systematic' ranking lose their main evidence. The shared-model concern raised by the reader is also valid and is partially present in my reading, but the significance gap is more directly falsifiable from the manuscript's own outputs. Verdict remains CONDITIONAL pending that check; no change from the reader's verdict.","tokens_in":7994,"tokens_out":6211,"duration_ms":68374,"concrete_test":"Re-run the T-REx retrieval on the biased HD 209458 b simulated spectrum of Section 3.1 with HCN and NH3 removed, and compute ΔlnZ or ΔBIC between the best model with and without those molecules. Also report the retrieved mixing ratios and posterior uncertainties for HCN and NH3. If |ΔlnZ| < 5 (or ΔBIC < 10) or the abundances are unconstrained, the 'false molecular detection' claim is not supported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper's headline result rests on the claim that a ~0.025-pixel horizontal-shift estimation error produces spurious HCN and NH3 detections in the simulated HD 209458 b spectrum. This claim is presented only as a visual T-REx fit (Figure 3); no detection significance, Bayesian evidence, ΔBIC, or abundance uncertainties are reported. A retrieval code will always assign some low abundance to additional molecules, and 'identified' is not the same as 'detected.' If the HCN and NH3 contributions are formally insignificant, then the central demonstration — that sub-percent-pixel shift errors create false molecular detections — does not exist. The quantitative threshold (better than 1% of a pixel) is then derived from an unquantified spectral trend. This is load-bearing because the paper uses the false-detection result to rank horizontal shifts as the most important systematic and to motivate the precision requirement.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper presents a forward-inverse simulation study of HST/WFC3 spatial-scan exoplanet spectroscopy. Using the Wayne simulator (Varley et al. 2017) and the Iraclis analysis pipeline, the authors generate synthetic observations of HD 209458 b and 55 Cancri e that include known WFC3 systematics and then test three perturbations: (i) miscalibrated horizontal shifts caused by ignoring the static flat-field component, (ii) in-scan drifts of ±2%, and (iii) enhanced/reduced non-linearity corrections. They report that horizontal-shift errors of order 0.025 pixels produce a wavelength-dependent bias and apparent HCN/NH3 features, that long scans such as 55 Cancri e are sensitive to in-scan drifts, and that non-linearity variations at the tested level do not affect the spectra. They conclude that horizontal shifts require calibration precision better than 1% of a pixel and that the published spectra are robust to the tested systematics.","tokens_in":8115,"tokens_out":7135,"duration_ms":69879,"significance":"If the conclusions were fully supported, this would be a useful methodological contribution: it demonstrates a practical way to benchmark WFC3 spectral extraction pipelines against known inputs, it identifies a specific calibration bias (ignoring the static flat-field component) that creates spurious molecular signatures, and it offers a blue-edge inclination diagnostic for in-scan drifts. The public availability of Wayne and Iraclis and the deliberate comparison of input and output spectra in simulated observations are strengths. However, the headline quantitative claims currently rest on visual T-REx fits and single noise realizations, and the benchmark shares code heritage with the pipeline it validates; for these reasons the significance is conditional on a major revision.","major_comments":[{"comment":"The statement that ~0.025-pixel horizontal-shift errors 'lead to the misinterpretation of the molecular consistency' and the identification of HCN and NH3 is not quantitatively established. The manuscript shows the best-fit T-REx model and molecule contributions but reports no detection significance, ΔBIC, Bayesian evidence, or abundance uncertainties. Because a retrieval will always assign small finite opacities to additional molecules, 'identified' does not imply 'detected.' This issue is load-bearing: the final '<1% of a pixel' precision requirement is motivated by the false-detection result. Please report a formal detection statistic or replace the conclusion with a more limited statement about spectral biases.","section":"Section 3, Figure 3"},{"comment":"The benchmark is circular in an important way. The input planetary spectra for the simulated observations are set to the spectra recovered by Iraclis itself from the real data, and both Wayne and Iraclis were developed within the same group (Varley, Tsiaras, Karpouzas; Tsiaras). A systematic error shared by the simulator and the analyzer would leave the input-output comparisons unchanged, so the tests cannot certify the absolute robustness of the published HD 209458 b and 55 Cancri e spectra. Please either validate against independent truth inputs (for example, spectra from a different retrieval code or a simulator constructed independently) or explicitly restrict the conclusions to the relative sensitivity to the injected systematics.","section":"Section 2 and Section 6"},{"comment":"No difference spectrum or inferred drift is reported with uncertainties, and each systematic level is represented by a single simulation. Consequently the residuals in Figures 2, 4, and 7 could be within noise, and statements such as 'in-scan drifts up to a level of +/-1% are... not detectable' (Section 4.2) have no statistical support. The '<1% of a pixel' threshold is also not directly tested: the demonstrated shift disagreement is about 0.025 pixels (2.5% of a pixel) with residuals between -2.5% and +1.0%, and no simulation is shown with a 1% shift error. Please add repeated noise realizations with propagated uncertainties, and either test the 1% level explicitly or rephrase the requirement as an order-of-magnitude recommendation.","section":"Sections 3-5"},{"comment":"The linear calibration between blue-edge inclination and in-scan drift is used to infer drifts of -0.08% and 0.17% in the real datasets, but the number of simulated drift levels, the scatter around the fitted line in Figure 5, and the uncertainties on the inferred drifts are not reported. Since this calibration is a new diagnostic and the conclusion that the real spectra are unaffected by in-scan drifts depends on it, please characterize its precision and provide uncertainties on the inferred values.","section":"Section 4.2"}],"minor_comments":[{"comment":"The text contains an apparent copy-paste error from Section 4 ('the spectrum of HD 209458 b is not sensitive to the in-scan drifts, while the spectrum of 55 Cancri e shows an increased slope...') in the discussion of non-linearity, as well as the malformed 'Figure 6 Figure 7'. Please rewrite this paragraph so it describes only the non-linearity results.","section":"Section 5.1"},{"comment":"Typos should be corrected: 'spacial scanning' (Section 6), 'ra requirement' (Section 5), 'better that 1%' (Abstract), 'the and 55 Cancri e dataset' (Section 1), 'HD 209548 b' (Figure 3 caption), and 'are to sufficent' (Section 4.2).","section":"Various"},{"comment":"The '+2% and -2%' drift values need their units and reference frame defined; it is not stated whether the percentage is relative to the scan length, the scan speed, or the pixel scale.","section":"Section 4"},{"comment":"The horizontal-shift calibration accuracy statement in Section 3 cites Varley et al. (2017) as 0.5% of a pixel, while the current test produces residuals up to 2.5%; a sentence reconciling these numbers would help the reader.","section":"Section 3"}],"recommendation":"major_revision","confidential_remarks":"To the editor: the shared-heritage issue between Wayne and Iraclis is the deepest concern; even with proper significance tests, the robustness claim would remain conditional unless the pipeline is benchmarked against independently constructed inputs. I would support publication after a major revision that adds statistics and either an external benchmark or careful scope limitation."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The useful core here is a simulation-based caution: for HD 209458 b, a horizontal-shift estimation bias as small as 0.025 pixels produces a clear wavelength-dependent distortion in the recovered transmission spectrum. That qualitative result is new, plausible, and worth taking seriously. The in-scan drift calibration line (blue-edge inclination vs. drift) is also a practical addition, and the non-linearity robustness test, despite its presentation problems, suggests current corrections are adequate. The paper does what the field needs more of: using a detailed simulator to stress-test a pipeline against known unknowns.\n\nNow the soft spots, in proportion. The stress-test note is right: Figure 3 shows HCN and NH3 contributions visually, but there is no detection significance, delta-BIC, or abundance uncertainty. A retrieval will always put some floor abundance into extra molecules; \"identified\" is not \"detected.\" Without a significance metric, the claim that a 0.025-pixel shift causes false detections is not quantitatively established. That weakens the paper's central headline and the \"better than 1% of a pixel\" threshold, which is inferred from an unquantified trend. This is a real flaw, but it is fixable and it does not invalidate the qualitative warning.\n\nThe single-realization-per-level design and the absence of error bars on all difference spectra are also limiting. With no noise realizations or uncertainties, we cannot tell whether the differences in Figures 2, 4, and 7 are systematics or just noise. The shared-model risk is real but not damning: Wayne and Iraclis come from the same group, and the input spectra are the pipeline's own recovered spectra, so a common bug could make the tests look better than they are. Independent validation would help, but the internal consistency of the tests is still informative.\n\nThere is also obvious copy-paste text in Section 5.1: the second paragraph repeats the in-scan drift discussion verbatim, and there are typos like \"ra requirement\" and \"spacial.\" Minor, but sloppy. The promised datasets and config files are not available, which is a bigger issue for reproducibility.\n\nWho is this for? Anyone reducing WFC3 spatial scans, and anyone interpreting published WFC3 transmission spectra. It deserves a serious referee: the topic matters, the simulation framework is well positioned, and the horizontal-shift caution is worth testing rigorously. The authors should be asked to add detection significance, error bars, and the data.\n\nRecommendation: send to peer review, but be prepared to require major revisions.","headline":"Useful simulation-based warning about horizontal shift calibration in WFC3 reductions, but the headline false-detection claim lacks statistical backing.","tokens_in":8706,"tokens_out":1205,"would_cite":true,"duration_ms":12408,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper shows that a 0.025-pixel horizontal-shift miscalibration in HST/WFC3 spatial-scan data changes the retrieved transmission spectrum and creates false HCN and NH3 detections, so shifts must be calibrated to better than 1% of a…","keywords":["exoplanet atmospheres","transmission spectroscopy","WFC3 spatial scans","horizontal shifts","systematics calibration","Wayne simulator","false molecular detections","Hubble Space Telescope"],"falsifier":"Generate a new set of simulations in which the input spectrum is flat, apply the same 0.025-pixel horizontal-shift bias during reduction, and check whether the output spectrum still develops a slope and whether a molecular retrieval code still reports HCN and NH3; if the artifacts disappear or shrink by more than an order of magnitude, the causal role of shift miscalibration would be disproven.","tokens_in":7735,"feed_emoji":"🔭","tokens_out":11366,"duration_ms":101856,"temperature":0.7,"pith_summary":"With no absolute calibration source for Hubble's WFC3 spatial-scan observations, the true planetary signal can never be known from real data alone. This paper uses the Wayne simulator to generate synthetic observations with known input systematics, then runs the standard reduction pipeline over them to see which systematics corrupt the final spectrum. The headline result is that horizontal shifts, the displacement of the spectrum between exposures, are the dominant systematic: a miscalibration of order 0.025 pixels produces a wavelength-dependent slope and makes a retrieval code identify HCN and NH3 that are not present. The paper also finds that in-scan drifts matter only for very long scans above roughly 1% drift, and that non-linearity variations at current uncertainty levels are too small to affect the spectra. The upshot is a concrete calibration requirement of better than 1% of a pixel for horizontal shifts, and a demonstration that the two most precise WFC3 spectra, HD 209458 b and 55 Cancri e, are stable under the other tested systematics.","feed_headline":"A 0.025-pixel shift error can invent exoplanet molecules","feed_subtitle":"Hubble WFC3 spectra need calibration precision better than 1% of a pixel to avoid false detections.","key_machinery":"The central object is the Wayne simulator, a tool that produces synthetic WFC3 spatial-scan exposures with all known instrument systematics and with user-controlled values for additional ones. The argument is carried by an input-output loop: the simulator's known input spectrum serves as ground truth, the standard reduction pipeline used for the real HD 209458 b and 55 Cancri e spectra is run on the simulated frames, and any difference between the recovered and input spectra is attributed to the injected systematic. The specific tests modify one thing at a time: the static flat-field component is ignored while estimating horizontal shifts, an in-scan drift is added during the scan, and the non-linearity coefficients are scaled up or down. For in-scan drifts, a secondary diagnostic is introduced: the inclination of the blue edge of the two-dimensional spectrum, which is shown to be linearly related to the drift and independent of the target.","core_discovery":"The paper's central discovery is that the most dangerous systematic in WFC3 spatial-scan spectroscopy is not an exotic one: it is the routine horizontal shift of the spectrum between exposures, when its estimation is biased. In a simulation where the input spectrum is known, deliberately miscalibrated shifts (discrepancies of the order of 0.025 pixels, varying between minus 2.5% and plus 1.0% of a pixel) change the recovered transmission spectrum by building up a slope toward longer wavelengths and strengthening the water feature; feeding that biased spectrum to a retrieval code makes it report HCN and NH3 even though neither molecule is present. The paper concludes that horizontal-shift calibration must be accurate to better than 1% of a pixel, and that the same simulation-based approach shows the spectra of HD 209458 b and 55 Cancri e are insensitive to in-scan drifts below about 1% and to non-linearity variations at the level of current uncertainties.","pith_inferences":["If the 1%-of-a-pixel threshold generalizes beyond WFC3, then any spectrograph that registers spectra by sub-pixel shifts could exhibit the same failure mode, and the HCN/NH3 example gives a concrete template for that artifact.","The blue-edge inclination diagnostic could be applied retroactively to archival long-scan WFC3 observations to flag datasets whose in-scan drift may exceed 1%.","Some reported molecular detections in WFC3 exoplanet spectra could be artifacts of horizontal-shift biases; re-running retrievals on spectra with shifts calibrated to sub-1%-of-a-pixel precision would test this directly."],"forward_implications":["Horizontal-shift calibration methods for WFC3 must be benchmarked against simulations; a shift error near 0.025 pixels can turn a spectrum into one that appears to contain HCN and NH3 when it does not.","The published HD 209458 b and 55 Cancri e spectra are stable against in-scan drifts below about 1% and against non-linearity variations at the level of the known correction uncertainties.","Long spatial scans, such as 55 Cancri e's roughly 350-pixel scan, should be checked for in-scan drift using the blue-edge inclination before their spectra are interpreted.","In the absence of absolute calibration targets, simulation-based validation becomes a necessary step for certifying any WFC3 transmission spectrum."],"supporting_citations":[{"why":"Introduces the Wayne simulator used to generate the synthetic observations and reports the 0.5%-of-a-pixel accuracy of the shift calibration method.","marker":"Varley et al. 2017"},{"why":"Provides the HD 209458 b spatial-scan dataset and is the original source of the horizontal-shift systematics under study.","marker":"Deming et al. 2013"},{"why":"Provides the 55 Cancri e dataset, the longest spatial scan used here, and the pipeline configuration being tested.","marker":"Tsiaras et al. 2016b"},{"why":"Describes the wavelength-calibration assumption, that the star moves parallel to the detector columns, which the in-scan drift tests stress.","marker":"Tsiaras et al. 2016a"},{"why":"Supplies the fourth-order non-linearity polynomial and coefficients that the simulations modify to create enhanced and reduced non-linearity cases.","marker":"Hilbert 2008"},{"why":"Documents the pixel-dependent deviations in WFC3 non-linearity correction that motivate testing non-linearity uncertainties.","marker":"Hilbert 2014"},{"why":"Provides the retrieval code used to identify HCN and NH3 in the horizontally shifted biased spectrum; its output defines the false-detection result.","marker":"Waldmann et al. 2015a,b"},{"why":"Describes the column-sum horizontal-shift calibration approach that the paper's shift estimation method follows.","marker":"Kreidberg et al. 2014b"}],"fun_headline_variants":["Tiny WFC3 shifts can fake exoplanet molecules","Sub-pixel drift invents false molecules in Hubble spectra","Horizontal shifts are the top WFC3 systematic for exoplanets","Better than 1% pixel calibration needed to avoid fake detections","Simulator exposes shift-induced phantoms in HST exoplanet spectra"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The conclusions assume the Wayne simulator faithfully reproduces the real WFC3 spatial-scan systematics and that the input spectra used as truth are representative; if the simulator and the reduction pipeline share a hidden flaw, the agreement between input and output spectra cannot certify the real observations.","fun_headline_variants_meta":{"raw":{"variants":["Tiny WFC3 shifts can fake exoplanet molecules","Sub-pixel drift invents false molecules in Hubble spectra","Horizontal shifts are the top WFC3 systematic for exoplanets","Better than 1% pixel calibration needed to avoid fake detections","Simulator exposes shift-induced phantoms in HST exoplanet spectra"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000213,"raw_usage":{"total_tokens":1431,"prompt_tokens":961,"completion_tokens":470,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":577,"completion_tokens_details":{"reasoning_tokens":380}},"tokens_in":577,"tokens_out":470,"duration_ms":4762,"temperature":1.0,"reasoning_tokens":380,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T15:05:40.939257+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Generate a new set of simulations in which the input spectrum is flat, apply the same 0.025-pixel horizontal-shift bias during reduction, and check whether the output spectrum still develops a slope and whether a molecular retrieval code still reports HCN and NH3; if the artifacts disappear or shrink by more than an order of magnitude, the causal role of shift miscalibration would be disproven.","supporting_citations":[{"cited_title":"2017, ApJS, 231, 13, doi: 10.3847/1538-4365/aa7750","cited_arxiv_id":null,"evidence_quote":"Introduces the Wayne simulator used to generate the synthetic observations and reports the 0.5%-of-a-pixel accuracy of the shift calibration method."},{"cited_title":"2008, WFC3 TV3 Testing: IR Channel Nonlinearity Correction, Tech","cited_arxiv_id":null,"evidence_quote":"Supplies the fourth-order non-linearity polynomial and coefficients that the simulations modify to create enhanced and reduced non-linearity cases."}],"review_version":1}