{"id":"1607b395-0150-4fa9-8e5b-5b89d590d93d","arxiv_id":"2507.14289","paper_version":2,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":4,"one_line_summary":"AstroWISP extracts few-parts-per-thousand photometry from Bayer-mask DSLR images and detects the WASP-33b transit.","lead":"AstroWISP is a new open-source software package that extracts precise star brightness measurements from ordinary color DSLR photos, whose built-in color filter pattern stymies standard astronomy tools. If it works as demonstrated, it enables amateur astronomers and citizen-science networks to detect and monitor exoplanet transits with cheap cameras.","discovery_kind":"new_method","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Transit depth agreement and per-exposure scatter do not establish high precision per exposure; a direct comparison against prior color-photometry efforts is needed to support the headline claim.","rationale":"The paper is a software description plus demonstration, and the transit detection with plausible depth is a genuinely useful validation. However, the 'significantly outperforming prior efforts' statement is the central claim that the strongest_claim and abstract rely on, and it is not directly demonstrated. The reader's weakest_assumption about unmodeled detector effects is the same concern I see: the precision claim is grounded in a measured scatter that could absorb or mask the effects of an incorrect S(x,y) or of neglected nonlinearity, and the raw-data demonstration cannot separate those. The load-bearing point is not merely that the assumption could be wrong but that the validation is insensitive to it: a fixed pattern error in S would change the k_p weights and the PSF-fit normalization, while unchanging the computed scatter, so the 'few parts per thousand per exposure' number would not detect the bias. That makes the performance claim insecure precisely where the paper needs it to be secure. A direct side-by-side comparison with prior methods is the most concrete way to test the actual head-to-head claim, and would also serve to calibrate whether the precision is really 'high' in the context the paper claims to surpass. I agree with the reader's CONDITIONAL verdict; the concern does not require rejection, but it prevents acceptance as is.","tokens_in":10041,"tokens_out":1569,"duration_ms":518687,"concrete_test":"Process the same set of PANOPTES images with a published earlier method (e.g., the custom photometry of Guyon & Martinache 2012 or Zhang et al. 2016) and with AstroWISP, with identical target lists, binning, and detrending; if AstroWISP's per-exposure scatter and transit-depth residuals are not better than the earlier method's, the headline outperformance claim in Sec. 3.2 should be weakened.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The central claim that AstroWISP 'significantly outperforms prior efforts' (Sec. 3.2) is not supported by any direct comparison. The WASP-33b transit fit is quoted as a success, but by the paper's own account this is based on raw, uncalibrated images, and the fitted depth (16.51 ppt) is compared to a literature value (16.78 ppt) using a non-standard depth definition. The stated uncertainty is small, yet the model assumes a static Bayer-mask sensitivity map S(x,y) and neglects brighter-fatter, charge bleeding, and antiblooming nonlinearity, all of which are named in Sec. 1 as relevant for DSLRs. Since the data are raw, if S or the PSF/PRF model absorbs an unmodeled pixel-level nonlinearity, the quoted per-exposure scatter in Sec. 3.2 would be optimistic rather than representative of the true photometric precision. The per-exposure 'few parts per thousand' claim is also based on median absolute deviation from a median of unbinned 2-min exposures, which does not separate atmospheric systematics or detrending choices from the software's precision, and does not provide the direct comparison to the earlier custom techniques that the paper claims.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents AstroWISP, an open-source C/C++ package with a Python wrapper for source extraction, background estimation, PSF/PRF fitting, and aperture photometry, aimed at high-precision photometry from consumer DSLR cameras with Bayer masks. The core algorithmic idea is to model subpixel sensitivity exactly by integrating polynomial PSF/PRF models over circle-rectangle overlaps, avoiding the approximation of treating color channels as densely packed pixels. The authors demonstrate the package on PANOPTES data: they detect the WASP-33b transit from uncalibrated DSLR images, measure a transit depth of 16.51^{+0.32}_{-0.30} ppt (literature 16.78 ppt), and report per-exposure median absolute deviations at the few-parts-per-thousand level for a field centered on FU Orionis. They claim this significantly outperforms prior custom photometry efforts for color images, and they package the tools for Windows, macOS, and Linux.","tokens_in":10334,"tokens_out":6580,"duration_ms":64810,"significance":"If the claims hold, AstroWISP is a valuable, well-packaged contribution to citizen-science photometry: it provides a cross-platform, freely available toolchain that models Bayer-mask effects without the need for custom per-project code, and the WASP-33b detection from raw, uncalibrated DSLR images is an encouraging empirical demonstration. The machine-checkable software distribution (Zenodo DOI, pre-built wheels, CI via cibuildwheel) and the use of real PANOPTES data are strengths. However, the headline claim of significantly outperforming prior efforts is not established by the evidence presented, and one algorithmic equation appears to contain an error. The contribution is therefore promising but requires revision.","major_comments":[{"comment":"The statement that AstroWISP enables 'a few parts per thousand photometric precision per exposure' and 'significantly outperforming prior efforts (e.g. Guyon & Martinache 2012; Zhang et al. 2016)' is not supported by the evidence presented. The only quantitative result is the median absolute deviation from the median of unbinned 2-min exposures for a single field; no side-by-side reduction of the same images with the cited prior methods is given, and the MAD scatter includes atmospheric, transparency, and detrending contributions that are not separated from the software's contribution. To support the claim, the authors should add a direct comparison using identical images and the same metric, or temper the claim to describe what is actually measured.","section":"§3.2"},{"comment":"The transit-depth agreement is reported as 16.51^{+0.32}_{-0.30} ppt versus a literature value of 16.78 ppt 'if we use our definition of the depth.' The depth is defined as the mean of the transit model over the central 50% of the time between first and fourth contact, which is not the standard full-transit depth reported in the exoplanet literature. The paper does not show how the 16.78 ppt literature value is converted to this definition, so the apparent agreement could be partly definitional. Please provide the literature-derived value evaluated with the same definition, or compare using the standard depth definition.","section":"§3.1"},{"comment":"The definition of k_p in Eq. (2) appears to have a technical error. The numerator integrates f+B over the pixel-aperture overlap without the subpixel sensitivity map S(x,y), while the denominator contains B plus an integral of f*S. If a pixel's sensitive area lies partly outside the aperture, this ratio does not give the fraction of the pixel's recorded flux that should be assigned to the aperture; for a Bayer pixel whose sensitive subarea is outside the aperture, k_p would be nonzero even though the pixel records no light from inside the aperture. The units also appear inconsistent because B is added to an integral of f over a dimensionless area. Please correct Eq. (2) or define all quantities with explicit units.","section":"§2.2, Eq. (2)"},{"comment":"The paper repeatedly states that AstroWISP uses 'exact analytical expressions' for integrals of arbitrary polynomials over all possible overlaps between circles and rectangles, ensuring machine precision without approximation, but it does not provide these expressions, a derivation, or a numerical validation. Since this exactness is a central algorithmic claim and distinguishes AstroWISP from approximate pixel-grid methods, please include the formulas in an appendix or provide a reference, together with a test showing agreement with high-resolution numerical integration.","section":"§2.1 and §2.2"}],"minor_comments":[{"comment":"The caption describes the small blue points as raw measurements but no per-point uncertainties are shown; please clarify whether the small points are individual color-channel measurements from all cameras, and describe how the binning and the RMS error bars were computed.","section":"Fig. 2 caption"},{"comment":"The word 'egreess' in the sentence about ingress/egress should be 'egress'.","section":"§3.1"},{"comment":"The claim that 'none of these tools were designed with color detectors in mind' is strong; consider rewording to 'do not natively model Bayer-mask subpixel sensitivity' or provide a reference for a specific counterexample.","section":"§1"},{"comment":"The mapping from a point (x,y) to the cell indices (i,j) used in Eq. (1) is not explicitly defined; please state that i,j are chosen such that x_i < x-x_0 < x_{i+1} and y_j < y-y_0 < y_{j+1}.","section":"§2.1, Eq. (1)"},{"comment":"It would be helpful to state the number of stars in each magnitude bin and the number of exposures used for the median absolute deviation calculation, as well as any outlier rejection criteria.","section":"§3.2"}],"recommendation":"major_revision","confidential_remarks":"The main obstacle is not the validity of the software or the transit detection, which are real contributions, but the unsupported 'significantly outperforming prior efforts' claim and the likely erroneous Eq. (2). If the authors add a direct comparison or temper the claim, fix Eq. (2), and provide the exact-integral formulas or a reference, I would be satisfied. The use of raw uncalibrated data is an honest limitation and should be retained, but the paper should be clearer that the quoted scatter is not purely the software's photometric precision."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"AstroWISP is a genuine contribution: a cross-platform, packaged tool for Bayer-mask-aware photometry, backed by a real WASP-33b transit detection from raw DSLR images. The paper oversells the precision claim, though—'significantly outperforming prior efforts' is not supported by the evidence shown.\n\nWhat's new: a maintained Python package with prebuilt wheels for Windows/macOS/Linux that does source extraction, background determination, PSF/PRF fitting, and aperture photometry with explicit subpixel sensitivity handling. That fills a real gap; prior work in this niche required custom code. The exact analytic circle-rectangle overlap integrals are a nice technical idea, but the paper doesn't provide a derivation or a benchmark demonstrating machine precision.\n\nThe WASP-33 demonstration is honest in its challenges: raw images, no calibration frames, variable exposure times. Detecting the transit and recovering a depth within ~1.5% of the literature value is a meaningful proof of concept. I also credit the authors for shipping the code on Zenodo and making it installable.\n\nSoft spots, in order of importance. First, no direct comparison against Guyon & Martinache (2012) or Zhang et al. (2016) appears anywhere. The 'significantly outperforms' claim relies on a single number—per-exposure scatter—that is the median absolute deviation of 2-min exposures after detrending. That metric includes atmospheric systematics and detrending choices, so it does not isolate what AstroWISP itself achieves. Second, the model assumes a static, known Bayer sensitivity map S(x,y) and ignores the brighter-fatter, charge-bleeding, and antiblooming nonlinearities the paper itself lists in Sec. 1. Since the demonstration uses raw data, those effects can be absorbed into the PSF/PRF fit, which would bias the quoted uncertainties. The 0.3 ppt error on the transit depth is probably optimistic. Third, the duration is 3.8 sigma off the literature value; the authors blame outlier points, but it's a warning that systematics are not fully under control.\n\nNone of this is fatal. The core capability—Bayer-mask photometry at the few-ppt level from uncalibrated DSLR frames—holds up. The paper would be stronger with a head-to-head comparison, a scatter metric separated from detrending, and more restrained language about outperformance.\n\nI'd send this to peer review; it's a solid software paper with checkable claims. The referee should ask for the comparison and for a discussion of how the ignored nonlinearities affect the error budget. For a reading group, it's a maybe—useful if anyone cares about citizen-science photometry or subpixel-sensitivity modeling.","headline":"A genuinely useful, packaged Bayer-mask photometry tool with a real transit detection, but the outperformance claim and per-exposure precision numbers need direct comparison and more careful systematics handling.","tokens_in":10863,"tokens_out":3606,"would_cite":false,"duration_ms":38559,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"AstroWISP extracts few-parts-per-thousand photometry from Bayer-masked DSLR images, enough to detect exoplanet transits.","keywords":["Bayer mask","aperture photometry","PSF fitting","DSLR cameras","exoplanet transits","citizen science","subpixel sensitivity","wide-field photometry"],"falsifier":"Take the same field and camera and reduce the images with and without flat-field calibration; if the few-parts-per-thousand scatter appears only in the uncalibrated case, the claim that such precision is achievable from raw data would not generalize. Alternatively, apply a dithered sequence and shift the assumed Bayer-mask registration by tenths of a pixel; if the measured flux of a constant star varies by more than the quoted precision, the assumed sensitivity map is not accurate enough.","tokens_in":9854,"feed_emoji":"📷","tokens_out":4530,"duration_ms":52263,"temperature":0.7,"pith_summary":"This paper presents AstroWISP, a set of image-processing tools for source extraction, background determination, PSF/PRF fitting, and aperture photometry, aimed at the color detectors found in consumer DSLR cameras. The authors claim that AstroWISP reaches a few parts per thousand photometric precision per 2-minute exposure on real PANOPTES data from Bayer-masked cameras, significantly outperforming prior custom efforts. They demonstrate that the tools recover the WASP-33b transit with a depth of $16.51\\pm0.32$ ppt, matching the literature value of 16.78 ppt, even though the images were raw and uncalibrated. The purpose is to make precision time-series photometry feasible for citizen scientists using inexpensive off-the-shelf equipment.","feed_headline":"Bayer-masked DSLR images yield few-parts-per-thousand photometry","feed_subtitle":"Open-source AstroWISP handles Bayer masks exactly, letting amateurs detect exoplanet transits.","key_machinery":"The load-bearing object is the per-pixel correction factor $k_p$ used in aperture photometry, defined as the ratio of the integral of the PSF-plus-background over the pixel-aperture intersection to the integral of the PSF times the Bayer sensitivity map over the full pixel. AstroWISP evaluates these integrals exactly, with machine precision, using closed-form expressions for integrals of arbitrary polynomials over all circle-rectangle overlaps. The PSF/PRF is represented as a piecewise bicubic function whose coefficients are set by values and mixed derivatives on interior cell corners, constrained to be smooth and to vanish on the outer grid boundary, with the source flux a separate global scaling factor. This machinery removes the two approximations that degrade standard photometry on color images: treating one color channel as a densely packed pixel grid and assuming a uniform flux distribution inside each pixel.","core_discovery":"The central claim is that the Bayer mask, normally a serious obstacle to precision photometry, can be modeled exactly rather than approximated away. AstroWISP accounts for the nonuniform subpixel sensitivity pattern $S(x,y)$ by computing exact analytical integrals of polynomial PSF models over the overlap between circular apertures and rectangular pixels, and it propagates pixel noise formally to every reported flux. On raw, uncalibrated PANOPTES DSLR images, this yields per-exposure scatter of a few parts per thousand in combined-channel light curves and better than 1% in individual color channels, and it detects the WASP-33b transit with depth $16.51^{+0.32}_{-0.30}$ ppt, timing offset $6.59^{+1.37}_{-1.35}$ minutes from the literature ephemeris, and duration $2.56\\pm0.05$ hours. The authors take this as evidence that consumer color cameras can be used for transit detection and ephemeris maintenance without calibration data, and that precision should improve further when calibration frames and fixed exposure times are used.","pith_inferences":["If the few-parts-per-thousand precision holds across diverse camera models and site conditions, networks of amateur DSLR systems could complement professional surveys by watching bright stars with deep, long-period transits that TESS undersamples.","The $k_p$ formalism could be extended to absorb pixel crosstalk, brighter-fatter, and antiblooming nonlinearity by replacing the static sensitivity map with an intensity-dependent map, potentially lowering the precision floor below the current demonstration.","The exact integral technique could generalize to elliptical or otherwise non-circular apertures, which would matter for wide-field corners where PSFs are elongated, while preserving the same error-propagation scheme.","A direct testable extension is to compare flat-fielded and unflat-fielded light curves of constant stars from the same DSLR; the difference would show how much of the residual scatter is calibratable versus intrinsic to the Bayer-mask model."],"forward_implications":["Amateur astronomers using consumer DSLR cameras can produce light curves precise enough to detect exoplanet transits, enabling community-based monitoring of long-period, bright-host planets.","The exact circle-rectangle integration applies beyond color detectors, improving photometry for monochrome cameras with nonuniform pixel response or undersampled PSFs.","The demonstrated work on raw, uncalibrated images lowers the practical burden of calibration data collection for citizen-science networks, while suggesting that adding darks and flats would push precision still lower.","The PSF/PRF fitting with smoothness constraints and external-catalog source positions can be reused in professional surveys that need careful handling of blended or poorly sampled sources.","Packaging the compiled tools as wheels for Windows, MacOS, and Linux makes the functionality accessible to a broad community without a compilation step."],"supporting_citations":[{"why":"Supplies one of the prior custom photometry efforts on color images that AstroWISP claims to significantly outperform.","marker":"Guyon & Martinache (2012)"},{"why":"Provides another previous custom technique for photometry from color images used as a performance baseline.","marker":"Zhang et al. (2016)"},{"why":"Represents a third prior effort requiring custom photometry, included in the comparison for the precision claim.","marker":"Gee et al. (2021)"},{"why":"Offers the fistar source-extraction tool from FITSH that AstroWISP incorporates and recompiles for three operating systems.","marker":"Pál (2012)"},{"why":"Provides astrometry.net, used by the companion pipeline for the initial sky-to-image transformation.","marker":"Lang et al. (2010)"},{"why":"Supplies the external Gaia catalog that drives the refined astrometric solution and supplies blended-source information.","marker":"Gaia Collaboration et al. (2023)"},{"why":"Provides emcee, the MCMC sampler used to fit transit parameters and quantify their uncertainties.","marker":"Foreman-Mackey et al. (2013)"},{"why":"Provides pytransit, the transit model used in the MCMC analysis of the WASP-33 light curve.","marker":"Parviainen (2015)"},{"why":"Gives the literature ephemeris and transit parameters for WASP-33b against which the recovered depth, timing, and duration are compared.","marker":"Zhang et al. (2018)"}],"fun_headline_variants":["Exact Bayer mask model turns DSLRs into precision photometers","AstroWISP exact Bayer mask handling yields ppt-level DSLR photometry","Consumer DSLRs do precision photometry via exact Bayer mask modeling","Exact analytical pixel integrals let amateurs detect transits with DSLRs","Bayer mask exact handling unlocks sub-1% color photometry on DSLRs"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The method assumes that the Bayer-mask sensitivity map $S(x,y)$ is known and static and that pixel-level effects such as charge bleeding, brighter-fatter, and antiblooming nonlinearity are negligible; the demonstration on raw, uncalibrated images does not independently check this.","fun_headline_variants_meta":{"raw":{"variants":["Exact Bayer mask model turns DSLRs into precision photometers","AstroWISP exact Bayer mask handling yields ppt-level DSLR photometry","Consumer DSLRs do precision photometry via exact Bayer mask modeling","Exact analytical pixel integrals let amateurs detect transits with DSLRs","Bayer mask exact handling unlocks sub-1% color photometry on DSLRs"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000442,"raw_usage":{"total_tokens":2228,"prompt_tokens":920,"completion_tokens":1308,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":536,"completion_tokens_details":{"reasoning_tokens":1213}},"tokens_in":536,"tokens_out":1308,"duration_ms":10891,"temperature":1.0,"reasoning_tokens":1213,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-06T16:00:27.657312+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Take the same field and camera and reduce the images with and without flat-field calibration; if the few-parts-per-thousand scatter appears only in the uncalibrated case, the claim that such precision is achievable from raw data would not generalize. Alternatively, apply a dithered sequence and shift the assumed Bayer-mask registration by tenths of a pixel; if the measured flux of a constant star varies by more than the quoted precision, the assumed sensitivity map is not accurate enough.","supporting_citations":[{"cited_title":"2012, in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol","cited_arxiv_id":null,"evidence_quote":"Supplies one of the prior custom photometry efforts on color images that AstroWISP claims to significantly outperform."},{"cited_title":"T., Guyon , O., Jovanovic , N., et al","cited_arxiv_id":null,"evidence_quote":"Represents a third prior effort requiring custom photometry, included in the comparison for the precision claim."}],"review_version":1}