Robust Measurement of Stellar Streams Around the Milky Way: Correcting Spatially Variable Observational Selection Effects in Optical Imaging Surveys
Pith reviewed 2026-05-18 08:55 UTC · model grok-4.3
The pith
Modeling detection rates from synthetic injections corrects artificial density fluctuations in Milky Way stellar streams.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Detection and classification rates in DES Y3 data can be expressed as nearly separable functions of survey properties using Balrog synthetic source injections. Applying the resulting maps reduces the standard deviation of relative detection rates across the DES footprint by a factor of five. The corrections materially alter the inferred linear density of the Phoenix stream when faint objects are retained. Artificial streams embedded in DES-like data recover their input density power spectra with reduced bias, while uncorrected LSST-like data would carry roughly five times larger bias.
What carries the argument
Balrog synthetic source injections used to map detection-rate and classification-rate variations as functions of survey properties such as seeing and sky brightness.
If this is right
- Measured stellar-stream densities become cleaner probes of low-mass dark matter substructure.
- Linear densities inferred for streams such as Phoenix shift when faint stars are included after correction.
- Density power spectra extracted from streams suffer less bias than in uncorrected catalogs.
- Uncorrected analyses of LSST-like data would retain roughly five times larger bias in power spectra.
Where Pith is reading between the lines
- The same injection-based mapping could be ported to other wide-field optical surveys to improve substructure measurements.
- Separability of the rates may allow rapid re-derivation of corrections when new survey-property maps become available.
- Combining the corrected densities with kinematic data could help isolate genuine dark-matter signals from residual systematics.
Load-bearing premise
Balrog synthetic source injections accurately reproduce the real detection and star-galaxy classification rates as functions of survey properties, and those rates remain nearly separable.
What would settle it
Insert artificial streams with known input density power spectra into the DES images, apply the corrections, and check whether the recovered power spectra match the input spectra within the reduced bias level reported.
Figures
read the original abstract
Observations of density variations in stellar streams are a promising probe of low-mass dark matter substructure in the Milky Way. However, survey systematics such as variations in seeing and sky brightness can also induce artificial fluctuations in the observed densities of known stellar streams. These variations arise because survey conditions affect both object detection and star--galaxy misclassification rates. To mitigate these effects, we use Balrog synthetic source injections in the Dark Energy Survey (DES) Y3 data to calculate detection rate variations and classification rates as functions of survey properties. We show that these rates are nearly separable with respect to survey properties and can be estimated with sufficient statistics from the synthetic catalogs. Applying these corrections reduces the standard deviation of relative detection rates across the DES footprint by a factor of five, and our corrections significantly change the inferred linear density of the Phoenix stream when including faint objects. Additionally, for artificial streams with DES like survey properties we are able to recover density power spectra with reduced bias. We also find that uncorrected power-spectrum results for LSST-like data can be around five times more biased, highlighting the need for such corrections in future ground based surveys.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that Balrog synthetic source injections into DES Y3 imaging can be used to map spatially varying detection and star-galaxy classification rates as functions of survey properties (seeing, sky brightness, etc.). These rates are shown to be nearly separable, allowing corrections that reduce the standard deviation of relative detection rates across the DES footprint by a factor of five, revise the inferred linear density of the Phoenix stream at faint magnitudes, and reduce bias in recovered density power spectra for artificial streams with DES-like properties. The work also notes that uncorrected LSST-like data can suffer ~5x larger bias in power-spectrum measurements.
Significance. If the Balrog-based corrections are shown to be accurate, the method would substantially improve the reliability of stellar-stream density measurements as a probe of low-mass dark-matter substructure. The reported quantitative gains (factor-of-five reduction in detection-rate scatter, revised Phoenix density, and lower power-spectrum bias) directly address a known source of artificial fluctuations in wide-field surveys and provide a practical template for future surveys such as LSST.
major comments (2)
- [Methods / Validation] The central results rest on the untested claim that Balrog injections faithfully reproduce the joint dependence of detection probability and star-galaxy misclassification on survey properties for the color and size distribution of faint stream stars. No external cross-check (e.g., against spectroscopic truth samples or deeper imaging) is presented to quantify residual 10-20% errors in regions of poor seeing or high sky brightness; this directly affects the reported factor-of-five variance reduction and the Phoenix density shift.
- [Results] The statement that detection and classification rates 'are nearly separable' with respect to survey properties is asserted but not accompanied by a quantitative error budget or residual map showing the size of the non-separable component; without this, it is unclear whether the separability approximation introduces systematic errors comparable to the corrections being applied.
minor comments (2)
- [Phoenix stream results] Clarify the exact magnitude range and color cuts used for the Phoenix stream analysis when faint objects are included, and show the corresponding uncorrected vs. corrected linear-density profiles side-by-side.
- [Power-spectrum validation] Add a brief description of how the artificial streams used for the power-spectrum test were generated (input density profile, width, and placement relative to survey-property variations).
Simulated Author's Rebuttal
We thank the referee for their thoughtful and constructive report. The comments highlight important aspects of validation and quantification that we will address in the revision. We respond to each major comment below.
read point-by-point responses
-
Referee: [Methods / Validation] The central results rest on the untested claim that Balrog injections faithfully reproduce the joint dependence of detection probability and star-galaxy misclassification on survey properties for the color and size distribution of faint stream stars. No external cross-check (e.g., against spectroscopic truth samples or deeper imaging) is presented to quantify residual 10-20% errors in regions of poor seeing or high sky brightness; this directly affects the reported factor-of-five variance reduction and the Phoenix density shift.
Authors: We agree that targeted validation for the specific color and size distribution of faint stream stars strengthens the central claims. Balrog has been validated for DES Y3 detection and classification in prior work, and our injections were constructed to match the relevant magnitude, color, and size distributions of stream stars. However, to directly address the concern about residual errors in poor seeing or high sky brightness, we will add a new subsection in the revised manuscript that compares Balrog-derived rates against independent estimates from overlapping deeper imaging fields and available spectroscopic truth samples. This will include a quantitative assessment of any 10-20% level residuals and their potential impact on the reported factor-of-five reduction and Phoenix density shift. revision: yes
-
Referee: [Results] The statement that detection and classification rates 'are nearly separable' with respect to survey properties is asserted but not accompanied by a quantitative error budget or residual map showing the size of the non-separable component; without this, it is unclear whether the separability approximation introduces systematic errors comparable to the corrections being applied.
Authors: We will revise the manuscript to provide the requested quantitative support for the separability claim. In the updated version we will include both a residual map after applying the separable model and an explicit error budget that compares the amplitude of any non-separable residuals to the size of the corrections themselves. Our internal checks indicate that the non-separable contribution is small relative to the overall improvement, but we will present this analysis clearly with supporting figures so readers can evaluate the approximation directly. revision: yes
Circularity Check
No significant circularity: empirical rates measured directly from Balrog injections and validated on artificial streams with known inputs
full rationale
The paper's central chain consists of injecting synthetic sources via Balrog into real DES Y3 imaging, measuring detection and classification rates as functions of survey properties, demonstrating near-separability from those measurements, and applying the resulting correction maps. These steps are direct empirical extractions rather than derivations that reduce to fitted parameters or self-referential definitions. The power-spectrum recovery test injects artificial streams with known input densities and shows reduced bias after correction, providing an external benchmark independent of the real-stream data. No load-bearing step equates a prediction to its own input by construction, and no self-citation chain is invoked to justify uniqueness or an ansatz. The method is therefore self-contained against the synthetic-injection benchmark.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption Balrog synthetic source injections accurately reproduce the real detection and star-galaxy classification rates as functions of survey properties.
- domain assumption Detection and classification rates are nearly separable with respect to survey properties.
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
We use Balrog synthetic source injections ... to calculate detection rate variations and classification rates as functions of survey properties. We show that these rates are nearly separable ... Applying these corrections reduces the standard deviation of relative detection rates ... by a factor of five
-
IndisputableMonolith/Foundation/AlexanderDuality.leanalexander_duality_circle_linking unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
for artificial streams with DES like survey properties we are able to recover density power spectra with reduced bias
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Abazajian, K., Adelman-McCarthy, J. K., Ag¨ ueros, M. A., et al. 2004, The Astronomical Journal, 128, 502–512
work page 2004
-
[2]
Abbott, T. M. C., Abdalla, F. B., Allam, S., et al. 2018, The Astrophysical Journal Supplement Series, 239, 18
work page 2018
-
[3]
2025a, The Open Journal of Astrophysics, 8, 65, arXiv:2501.05683
Anbajagane, D., Tabbutt, M., Beas-Gonzalez, J., et al. 2025a, The Open Journal of Astrophysics, 8, 65, arXiv:2501.05683
-
[4]
2025b, arXiv e-prints, arXiv:2502.17674, arXiv:2502.17674 Astropy Collaboration, Robitaille, T
Anbajagane, D., Chang, C., Zhang, Z., et al. 2025b, arXiv e-prints, arXiv:2502.17674, arXiv:2502.17674 Astropy Collaboration, Robitaille, T. P., Tollerud, E. J., et al. 2013, A&A, 558, A33, arXiv:1307.6212
- [5]
- [6]
- [7]
-
[8]
Banik, N., Bovy, J., Bertone, G., Erkal, D., & de Boer, T. J. L. 2021, Monthly Notices of the Royal Astronomical Society, 502, 2364–2380
work page 2021
-
[9]
2015, The Astrophysical Journal, 807, 50
Bechtol, K., Drlica-Wagner, A., Balbinot, E., et al. 2015, The Astrophysical Journal, 807, 50
work page 2015
-
[10]
2022, arXiv e-prints, arXiv:2203.07354, arXiv:2203.07354
Bechtol, K., Birrer, S., Cyr-Racine, F.-Y., et al. 2022, arXiv e-prints, arXiv:2203.07354, arXiv:2203.07354
-
[11]
Bernard, E. J., Ferguson, A. M. N., Schlafly, E. F., et al. 2014, MNRAS, 443, L84, arXiv:1405.6645
work page internal anchor Pith review Pith/arXiv arXiv 2014
-
[12]
Bonaca, A., Hogg, D. W., Price-Whelan, A. M., & Conroy, C. 2019, ApJ, 880, 38, arXiv:1811.03631
-
[13]
Bonaca, A. & Price-Whelan, A. M. 2025, NewAR, 100, 101713, arXiv:2405.19410
- [14]
-
[15]
Bonaca, A., Naidu, R. P., Conroy, C., et al. 2021, ApJL, 909, L26, arXiv:2012.09171
-
[16]
Bovy, J., Erkal, D., & Sanders, J. L. 2017, MNRAS, 466, 628, arXiv:1606.03470
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[17]
2012, Monthly Notices of the Royal Astronomical Society, 427, 127–145
Bressan, A., Marigo, P., Girardi, L., et al. 2012, Monthly Notices of the Royal Astronomical Society, 427, 127–145
work page 2012
-
[18]
Buckley, M. R. & Peter, A. H. G. 2018, PhR, 761, 1, arXiv:1712.06615
work page internal anchor Pith review Pith/arXiv arXiv 2018
- [19]
-
[20]
2019, MNRAS, 489, 2247, arXiv:1905.08103
Chabanier, S., Millea, M., & Palanque-Delabrouille, N. 2019, MNRAS, 489, 2247, arXiv:1905.08103
-
[21]
Dekker, A., Ando, S., Correa, C. A., & Ng, K. C. Y. 2022, PhRvD, 106, 123026, arXiv:2111.13137
- [22]
-
[23]
T., Neilsen, E., Gruendl, R., et al
Diehl, H. T., Neilsen, E., Gruendl, R., et al. 2016, in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol. 9910, Observatory Operations: Strategies, Processes, and Systems VI, ed. A. B. Peck, R. L. Seaman, & C. R. Benn, 99101D
work page 2016
-
[24]
2020, The Astrophysical Journal, 893, 47
Drlica-Wagner, A., Bechtol, K., Mau, S., et al. 2020, The Astrophysical Journal, 893, 47
work page 2020
-
[25]
Drlica-Wagner, A., Carlin, J. L., Nidever, D. L., et al. 2021, ApJS, 256, 2, arXiv:2103.07476
-
[26]
Erkal, D., Belokurov, V., Bovy, J., & Sanders, J. L. 2016, MNRAS, 463, 102, arXiv:1606.04946
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[27]
Erkal, D., Koposov, S. E., & Belokurov, V. 2017, MNRAS, 470, 60, arXiv:1609.01282
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[28]
2022, The Astrophysical Journal Supplement Series, 258, 15
Everett, S., Yanny, B., Kuropatkin, N., et al. 2022, The Astrophysical Journal Supplement Series, 258, 15
work page 2022
-
[29]
Flaugher, B., Diehl, H. T., Honscheid, K., et al. 2015, The Astronomical Journal, 150, 150 G´ orski, K. M., Hivon, E., Banday, A. J., et al. 2005, ApJ, 622, 759, arXiv:astro-ph/0409513
work page internal anchor Pith review Pith/arXiv arXiv 2015
-
[30]
Grillmair, C. J. 2017, ApJ, 847, 119, arXiv:1708.09029 24
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[31]
Harris, C. R., Millman, K. J., van der Walt, S. J., et al. 2020, Nature, 585, 357–362
work page 2020
-
[32]
Hartley, W. G., Choi, A., Amon, A., et al. 2021, Monthly Notices of the Royal Astronomical Society, 509, 3547–3579
work page 2021
-
[33]
Hunter, J. D. 2007, Computing in science and engineering, 9, 90 Ivezi´ c, Z., Kahn, S. M., Tyson, J. A., et al. 2019, The Astrophysical Journal, 873, 111
work page 2007
-
[34]
The upper bound on the lowest mass halo
Jethwa, P., Erkal, D., & Belokurov, V. 2018, MNRAS, 473, 2060, arXiv:1612.07834
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[35]
Piercing the Milky Way: an all-sky view of the Orphan Stream
Koposov, S. E., Belokurov, V., Li, T. S., et al. 2019, MNRAS, 485, 4726, arXiv:1812.08172 K¨ upper, A. H. W., Kroupa, P., Baumgardt, H., & Heggie, D. C. 2010, MNRAS, 401, 105, arXiv:0909.2619
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[36]
Li, T. S., Koposov, S. E., Zucker, D. B., et al. 2019, MNRAS, 490, 3508, arXiv:1907.09481
-
[37]
Li, T. S., Koposov, S. E., Erkal, D., et al. 2021, ApJ, 911, 149, arXiv:2006.10763
- [38]
-
[39]
2025, Detectability of dark matter subhalo impacts in Milky Way stellar streams
Lu, J., Lin, T., Sholapurkar, M., & Bonaca, A. 2025, arXiv e-prints, arXiv:2502.07781, arXiv:2502.07781
-
[40]
Malhan, K., Ibata, R. A., & Martin, N. F. 2018, MNRAS, 481, 3442, arXiv:1804.11339
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[41]
2023, MNRAS, 520, 5225, arXiv:2204.10326
Mateu, C. 2023, MNRAS, 520, 5225, arXiv:2204.10326
-
[42]
Nadler, E. O., Wechsler, R. H., Bechtol, K., et al. 2020, ApJ, 893, 48, arXiv:1912.03303
-
[43]
Newberg, H. J. & Carlin, J. L. 2016, Tidal Streams in the Local Group and Beyond, Vol. 420 (Springer)
work page 2016
-
[44]
2021, JCAP, 2021, 062, arXiv:2011.08865
Newton, O., Leo, M., Cautun, M., et al. 2021, JCAP, 2021, 062, arXiv:2011.08865
-
[45]
Detection of massive tidal tails around the globular cluster Pal 5 with SDSS commissioning data
Odenkirchen, M., Grebel, E. K., Rockosi, C. M., et al. 2001, ApJL, 548, L165, arXiv:astro-ph/0012311
work page internal anchor Pith review Pith/arXiv arXiv 2001
-
[46]
Patrick, J. M., Koposov, S. E., & Walker, M. G. 2022, MNRAS, 514, 1757, arXiv:2206.04241 Rodr´ ıguez-Monroy, M., Weaverdyck, N., Elvin-Poole, J., et al. 2022, MNRAS, 511, 2665, arXiv:2105.13540 Rodr´ ıguez-Monroy, M., Weaverdyck, N., Elvin-Poole, J., et al. 2022, Monthly Notices of the Royal Astronomical Society, 511, 2665–2687
-
[47]
2021, The Astrophysical Journal Supplement Series, 254, 24
Sevilla-Noarbe, I., Bechtol, K., Carrasco Kind, M., et al. 2021, The Astrophysical Journal Supplement Series, 254, 24
work page 2021
-
[48]
Stellar Streams Discovered in the Dark Energy Survey
Shipp, N., Drlica-Wagner, A., Balbinot, E., et al. 2018, ApJ, 862, 114, arXiv:1801.03097
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[49]
2018, The Astrophysical Journal, 862, 114
Shipp, N., Drlica-Wagner, A., Balbinot, E., et al. 2018, The Astrophysical Journal, 862, 114
work page 2018
-
[50]
Shipp, N., Li, T. S., Pace, A. B., et al. 2019, ApJ, 885, 3, arXiv:1907.09488
-
[51]
Suchyta, E., Huff, E. M., Aleksi´ c, J., et al. 2016, Monthly Notices of the Royal Astronomical Society, 457, 786–808
work page 2016
-
[52]
Tabbutt, M. 2023, U. Wisconsin, Madison PhD thesis
work page 2023
-
[53]
2022, The Astrophysical Journal, 925, 118
Tavangar, K., Ferguson, P., Shipp, N., et al. 2022, The Astrophysical Journal, 925, 118
work page 2022
-
[54]
Treu, T. 2010, ARA&A, 48, 87, arXiv:1003.5567
work page internal anchor Pith review Pith/arXiv arXiv 2010
-
[55]
2025, The Open Journal of Astrophysics, 8
Tsiane, K., Mau, S., Drlica-Wagner, A., et al. 2025, The Open Journal of Astrophysics, 8
work page 2025
-
[56]
2024, SSRv, 220, 58, arXiv:2306.11781
Vegetti, S., Birrer, S., Despali, G., et al. 2024, SSRv, 220, 58, arXiv:2306.11781
- [57]
- [58]
-
[59]
2019, Journal of Open Source Software, 4, 1298
Zonca, A., Singer, L., Lenz, D., et al. 2019, Journal of Open Source Software, 4, 1298
work page 2019
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.