{"id":"c5df7378-5c1b-498e-8e36-cf734052a781","arxiv_id":"1908.06586","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":4.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":1,"one_line_summary":"The ESTES starting-track selection is projected, using Monte Carlo simulations, to collect a high-purity sample of astrophysical muon neutrinos above 1 TeV with about one atmospheric-muon background event per year.","lead":"IceCube researchers describe a new event selection, ESTES, that uses machine learning to pick out muon neutrinos whose tracks start inside the detector. This study uses simulated events only and reports expected astrophysical neutrino rates for an upcoming measurement of the diffuse neutrino flux.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The claimed ~1 muon/yr background after the BDT cut rests entirely on simulation; a data sideband check is needed to validate the steep BDT tail before the 'negligible contamination' claim can be accepted.","rationale":"The reader's verdict of CONDITIONAL is appropriate. The paper reports a Monte Carlo sensitivity projection for a new event selection, and the central claim of high neutrino purity with ~1 atmospheric muon per year after the BDT cut is entirely simulation-based. The paper itself explicitly notes in Section 5 that data-compatibility checks are ongoing, which is the decisive reason the result cannot be fully accepted. My stress-test identifies the same load-bearing assumption: the BDT score cut is tuned to achieve a specific muon rate in simulation, and the tail of the BDT distribution is steep, so small simulation mismodeling could change the background by an order of magnitude. The concrete sideband test would directly address this by comparing the predicted and observed BDT score distributions in a background-dominated region before trusting the extrapolation to the final cut. I do not find an additional internal inconsistency that would warrant moving the verdict to REJECT or UNVERDICTED; the analysis is plausible and appropriately preliminary. Therefore the reader's CONDITIONAL verdict remains unchanged.","tokens_in":4077,"tokens_out":5340,"duration_ms":54900,"concrete_test":"Perform a data sideband test: apply the full ESTES selection but with the final BDT cut lowered to a score range just below 0.991 (e.g., 0.95–0.985), where the simulated muon background is still sufficiently large to yield events in the existing data (IC86, 2011–2019). Compare the observed event count as a function of BDT score to the Monte Carlo prediction. If the data/MC ratio in the sideband is consistent with 1 within statistical and systematic uncertainties, extrapolate to scores >0.991 and verify that the expected background remains at or below a few per year. If the sideband already shows an excess or a deficit versus MC, the 1/yr cut value is not reliable and the central background-rejection claim is unvalidated.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central numerical claim, that the ESTES selection yields negligible atmospheric muon background with >80% neutrino efficiency, depends on the BDT cut of 0.991 being chosen so that the simulated muon rate above the cut is 1 per year (Sec. 3.2, Fig. 4). This number is an extrapolation from Monte Carlo into the extreme tail of the BDT score distribution, where the muon rate falls by roughly four orders of magnitude (10^4 to 1 per year). The training/test KS test (p=0.30) only checks for overfitting within Monte Carlo; it says nothing about whether the simulation reproduces the real detector response or cosmic-ray muon flux. The paper itself states (Sec. 5) that checks for compatibility with real data are still ongoing. If the true muon rate above 0.991 is not 1/yr but, say, 10/yr, the 'negligible contamination' claim fails and the sample's neutrino purity drops substantially. No systematic uncertainties are given for the background estimate, and the assumed Gaisser H4a flux is only one model. This is the weakest load-bearing element because every subsequent physics result (rates in Table 2, sensitivity statements) assumes the background is actually negligible.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The manuscript presents ESTES, an IceCube event selection designed to isolate starting muon-neutrino tracks in the southern sky for a diffuse neutrino flux measurement above 1 TeV. The authors describe a two-step selection: a starting track veto that reduces the atmospheric muon rate from over 100 million to about 10 thousand per year, followed by an XGBoost boosted decision tree that reduces the expected muon rate to about 1 per year at a score cut of 0.991, while retaining over 80% of signal neutrinos. Using Monte Carlo simulations, they compute expected astrophysical neutrino rates for four published diffuse flux models (MESE, HESE, NuMu, and Inelasticity), and report that data-compatibility checks are still ongoing. The paper is explicitly a sensitivity study based on simulations only.","tokens_in":4427,"tokens_out":6228,"duration_ms":64453,"significance":"If the claimed background rejection and neutrino efficiency are confirmed in data, ESTES would provide a valuable new channel for diffuse muon neutrino measurements, complementing the northern-sky-dominated NuMu analysis and the cascade-oriented MESE and HESE selections. The manuscript is transparent about its scope: it presents a Monte Carlo sensitivity study with statistical-only uncertainties, and it openly states that data validation is pending. The expected rates in Table 2 are a useful benchmark for the selection's performance. However, the significance of the current claims is limited by the lack of a quantitative sensitivity estimate, the reliance on an unvalidated Monte Carlo tail for the background, and the absence of systematic uncertainties. The paper is a promising work-in-progress report rather than a completed measurement.","major_comments":[{"comment":"The central claim that the final ESTES selection has 'negligible amounts of background contamination' rests on extrapolating the atmospheric muon rate from approximately 10^4 events per year at low BDT scores to 1 event per year at the chosen cut of 0.991. This is a four-order-of-magnitude extrapolation into the tail of the BDT score distribution where simulated muon statistics are sparse. The Kolmogorov–Smirnov test (p = 0.30) reported in Sec. 3.2 checks overfitting between training and test Monte Carlo samples; it does not validate the absolute normalization of the tail against real data. The paper itself states in Sec. 5 that data-compatibility checks are ongoing. Until a data sideband check or an explicit systematic uncertainty on the tail rate (including cosmic-ray model variations and MC statistics) is provided, the 'negligible contamination' statement is not supported. This is load-bearing because all subsequent rate predictions assume a negligible background.","section":"3.2, Fig. 4"},{"comment":"The abstract and introduction promise a sensitivity study for the diffuse neutrino flux, but the paper does not present a quantitative sensitivity: there is no expected uncertainty on Φ0 and γ, no confidence interval, and no treatment of background normalization in a fit. The expected event counts in Table 2 are raw rates with statistical uncertainties from the Monte Carlo only; they do not by themselves demonstrate the sensitivity of the measurement. A simple counting-experiment calculation using the quoted signal rates and the 1 event/yr background would be a minimal step, and a full treatment would propagate systematic uncertainties. Without this, the stated goal of showing sensitivity for a diffuse flux measurement is not yet met.","section":"4, Table 2"},{"comment":"The atmospheric muon background is obtained from two different simulations (CORSIKA with multiple muons at 1/10 year livetime and a parametrized single-muon sample at over 10 years livetime) using a single cosmic-ray flux model, Gaisser H4a. The manuscript does not explain how these two samples are combined or cross-normalized in Fig. 4, nor does it discuss the uncertainty in the cosmic-ray flux model. Since the BDT cut is selected to yield exactly 1 muon per year from this simulation, the resulting background estimate is directly tied to these choices. The paper should describe the combination procedure and provide a systematic error estimate on the background rate.","section":"2.1, 3.2"}],"minor_comments":[{"comment":"The word 'Relevent' should be 'Relevant' in the sentence discussing energy reconstruction.","section":"2.2"},{"comment":"There is a typo 'bu northern sky' which should be 'by northern sky' in the comparison with the NuMu and inelasticity analyses.","section":"4"},{"comment":"The equation is typeset poorly and the parameters Φ0 and γ are not defined in the text; the functional form should be written as dΦ/dE = Φ0 × 10^{-18} (Eν/10^5 GeV)^{-γ} with units GeV^{-1} cm^{-2} s^{-1} sr^{-1}.","section":"Eq. (4.1)"},{"comment":"The caption states 'The dark region is shown in red'; the color terminology is confusing and should be clarified to match the figure.","section":"Fig. 1"},{"comment":"The paper claims a 'high purity' sample but does not quote an expected purity value; for the MESE flux the signal rate is 7.43/yr versus 1/yr background, and for HESE it is 16.07/yr versus 1/yr; the purity should be stated explicitly.","section":"Sec. 5"},{"comment":"References [8] and [11] lack journal volume and page numbers, making them incomplete for a journal-style bibliography.","section":"References"}],"recommendation":"major_revision","confidential_remarks":"The manuscript is a conference proceeding rather than a full journal article; its claims are appropriately scoped as a sensitivity study, but the central background estimate relies on an unvalidated Monte Carlo tail. The authors will need to add a data check or sideband analysis, a systematic uncertainty budget, and a quantitative sensitivity statement to meet the standards of a journal publication. The title's word 'Measurement' may also need to be softened to 'Sensitivity Study' unless data results are added."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Quick take: this is a conference proceeding that reports expected rates from a Monte Carlo selection, not a measurement. The title says \"Measurement\" but the abstract correctly says \"sensitivity\"—the paper is upfront that no data have been analyzed yet. Read it as a status report, not a result.\n\nWhat it does well: the BDT training is described clearly, the variables are listed, and the train/test KS test (p=0.30) is a reasonable check against overfitting. The expected neutrino rates for the four published fluxes (Table 2) are internally consistent, and the paper gives credit to prior ESTES work. For a proceedings, that is solid.\n\nThe soft spot is the background. The central claim that the final sample has \"negligible\" atmospheric muon contamination rests on a BDT cut at 0.991, chosen so that the simulated muon rate falls to 1 per year. That number is an extrapolation over roughly four orders of magnitude in the BDT tail. The KS test only checks agreement between train and test Monte Carlo; it does not validate that the simulation reproduces the real detector response or the cosmic-ray muon flux. The paper itself says data checks are ongoing, which is the right caveat, but the wording in Section 5 goes beyond that. There are also no systematic uncertainties on any of the expected rates, and the muon normalization assumes Gaisser H4a alone. For a sensitivity study that is not fatal, but it means the negligible-background claim is unproven.\n\nThe title is also misleading: it should say \"Sensitivity\" rather than \"Measurement.\" The abstract's first sentence is fine as a general IceCube statement, but the specific claim in the title and Section 5 overstates the current status.\n\nProportion: as a conference proceeding, this is acceptable and honest. It is not a journal paper. If it were submitted to a journal, I would desk reject it for lack of data and systematics, or send it back for major revision. For your purposes, it is worth a skim if you work on IceCube event selections, but I would not cite it as a measurement. My recommendation: take it as a preliminary status note; wait for the real data analysis.","headline":"A clear, honest Monte Carlo sensitivity study for IceCube's ESTES selection; the title oversells it as a 'measurement' and the negligible-background claim rests on an untested tail extrapolation.","tokens_in":4826,"tokens_out":3746,"would_cite":false,"duration_ms":39671,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Starting-track selection can deliver a high-purity diffuse muon neutrino sample.","keywords":["IceCube","diffuse neutrino flux","starting track events","boosted decision tree","atmospheric muon background","muon neutrinos","sensitivity study","ESTES"],"falsifier":"Open the 8 years of IC-86 data to ESTES and count the events passing the 0.991 BDT cut; if the observed total significantly exceeds the simulated expectation of about one atmospheric muon per year plus the predicted neutrino rate, the claim of negligible background is falsified. A direct check is to compare the BDT score distribution and the two most important input variables between data and Monte Carlo before applying the final cut.","tokens_in":3869,"feed_emoji":"🧊","tokens_out":6080,"duration_ms":56007,"temperature":0.7,"pith_summary":"This paper argues that a new IceCube event selection called ESTES can deliver a high-purity sample of astrophysical muon neutrinos above 1 TeV by keeping only tracks that start inside the detector and applying a machine-learned classifier. It reports that the final step reduces the expected atmospheric muon background to about one event per year while retaining over 80 percent of starting-track neutrinos. Using simulated neutrinos weighted to four published diffuse-flux measurements, it predicts between roughly 4 and 16 astrophysical neutrino events per year in the final sample. These numbers support the paper's central point: a low-background, southern-sky muon-neutrino sample is within reach for a diffuse flux measurement and for real-time multi-messenger alerts.","feed_headline":"IceCube selection isolates high-purity starting-track neutrinos","feed_subtitle":"A boosted decision tree cuts atmospheric muons to ~1 per year while keeping 80% of neutrino starting tracks.","key_machinery":"The load-bearing mechanism is a two-stage veto. First, a starting-track veto computes, from the reconstructed Cherenkov-cone geometry, the probability that optical modules in a dark region around the track observe light; a cut on this probability drops the muon rate from over $10^{8}$ to $10^{4}$ per year. Second, an XGBoost boosted decision tree, trained on 15 reconstructed variables, classifies surviving events; the most important variables are the fraction of energy lost in the first track segment and the distance from the vertex to the estimated entry point. The BDT score cut of 0.991, chosen to admit one muon per year, is the point at which the sample becomes neutrino-dominated.","core_discovery":"The central claim is that ESTES is a viable path to a diffuse muon neutrino flux measurement. The selection starts with a starting-track veto that lowers the atmospheric muon background from over 100 million to about 10 thousand events per year; a gradient-boosted decision tree then cuts the expected muon rate to roughly one per year at a BDT score of 0.991, while keeping more than 80% of neutrino starting tracks. When the selection is applied to simulated astrophysical neutrinos, the expected event rates depend on the assumed flux: 7.43 per year for the cascade-focused MESE measurement, 16.07 per year for the high-energy starting event HESE sample, 4.15 per year for the northern-sky NuMu analysis, and 7.43 per year for the inelasticity result. The paper therefore establishes sensitivity, not a measurement: no real data are shown, and validation that data match the Monte Carlo is stated as ongoing.","pith_inferences":["The BDT's top variable is the fraction of energy released in the first track segment; this makes the sample's effective acceptance depend on where the neutrino's first interaction deposits energy, so an independent cut-based selection would be a useful cross-check that the paper does not report.","ESTES targets the southern sky, where atmospheric muons are hardest to reject; combining it with the northern-sky NuMu analysis would give nearly full-sky coverage of muon-neutrino starting tracks, though no such combination is attempted here.","If the real 8-year data match the Monte Carlo, the next step implied by the design is a fit to the reconstructed energy losses to estimate the diffuse flux normalization and spectral index; the paper stops at expected-rate tables, so the fitting procedure and its systematic uncertainties remain open questions."],"forward_implications":["ESTES can yield an essentially background-free southern-sky muon-neutrino sample in the 1-100 TeV range, with expected astrophysical rates of 4-16 events per year depending on the true diffuse spectrum.","A fit to the final sample's reconstructed energy losses could constrain both the normalization and the spectral index of the diffuse astrophysical flux.","The large expected atmospheric neutrino component allows the same sample to constrain atmospheric flux models.","The selected starting-track events could feed a real-time multi-messenger alert stream, since each event carries a well-reconstructed direction."],"supporting_citations":[{"why":"Supplies the assumed cosmic-ray flux (Gaisser H4a) used to compute atmospheric muon rates.","marker":"[2]"},{"why":"Provides the SplineMPE track reconstruction that determines direction and inputs to the BDT.","marker":"[3]"},{"why":"Provides the Millipede energy-loss estimates along the track, the basis for the BDT's most important variable.","marker":"[4]"},{"why":"Describes the starting-track veto that reduces the muon rate from over 100 million to about 10 thousand per year.","marker":"[5]"},{"why":"Documents additional details of the starting-track veto used in the first selection step.","marker":"[6]"},{"why":"Supplies the XGBoost boosted decision tree algorithm used for the final muon-neutrino classification.","marker":"[7]"},{"why":"Injected MESE flux central values define one of the simulated diffuse spectra used for sensitivity estimates.","marker":"[8]"},{"why":"Injected HESE flux central values define another simulated diffuse spectrum used for sensitivity estimates.","marker":"[9]"},{"why":"Injected NuMu flux central values define the simulated northern-sky muon-neutrino spectrum used for comparison.","marker":"[10]"},{"why":"Injected inelasticity-result flux central values define the fourth simulated spectrum used for expected rates.","marker":"[11]"}],"fun_headline_variants":["Machine learning cleans IceCube's neutrino starting tracks","IceCube's ESTES: high-purity diffuse muon neutrinos","AI selects astrophysical muon neutrinos in IceCube","New selection yields one atmospheric muon per year","Sensitivity study for diffuse muon neutrinos in IceCube"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The entire background estimate and the chosen BDT cut rest on Monte Carlo simulation of atmospheric muons and detector response, and the paper states that compatibility checks with real IceCube data are still ongoing.","fun_headline_variants_meta":{"raw":{"variants":["Machine learning cleans IceCube's neutrino starting tracks","IceCube's ESTES: high-purity diffuse muon neutrinos","AI selects astrophysical muon neutrinos in IceCube","New selection yields one atmospheric muon per year","Sensitivity study for diffuse muon neutrinos in IceCube"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001147,"raw_usage":{"total_tokens":4708,"prompt_tokens":848,"completion_tokens":3860,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":464,"completion_tokens_details":{"reasoning_tokens":3779}},"tokens_in":464,"tokens_out":3860,"duration_ms":25554,"temperature":1.0,"reasoning_tokens":3779,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T12:39:13.249356+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Open the 8 years of IC-86 data to ESTES and count the events passing the 0.991 BDT cut; if the observed total significantly exceeds the simulated expectation of about one atmospheric muon per year plus the predicted neutrino rate, the claim of negligible background is falsified. A direct check is to compare the BDT score distribution and the two most important input variables between data and Monte Carlo before applying the final cut.","supporting_citations":[{"cited_title":"Mancina and M","cited_arxiv_id":null,"evidence_quote":"Supplies the assumed cosmic-ray flux (Gaisser H4a) used to compute atmospheric muon rates."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides the SplineMPE track reconstruction that determines direction and inputs to the BDT."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides the Millipede energy-loss estimates along the track, the basis for the BDT's most important variable."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Describes the starting-track veto that reduces the muon rate from over 100 million to about 10 thousand per year."},{"cited_title":"Jero, Journal of Physics: Conference Series 888 (2017) 012107","cited_arxiv_id":null,"evidence_quote":"Documents additional details of the starting-track veto used in the first selection step."},{"cited_title":"Mancina Presented at Neutrino Parallel TeVPA 2017 in Columbus, OH, 2017","cited_arxiv_id":null,"evidence_quote":"Supplies the XGBoost boosted decision tree algorithm used for the final muon-neutrino classification."},{"cited_title":"Chen and C","cited_arxiv_id":null,"evidence_quote":"Injected MESE flux central values define one of the simulated diffuse spectra used for sensitivity estimates."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Injected HESE flux central values define another simulated diffuse spectrum used for sensitivity estimates."},{"cited_title":"Schneider, PoS(ICRC2019)1004 (2019)","cited_arxiv_id":null,"evidence_quote":"Injected NuMu flux central values define the simulated northern-sky muon-neutrino spectrum used for comparison."},{"cited_title":"Stettner, PoS(ICRC2019)1017 (2019)","cited_arxiv_id":null,"evidence_quote":"Injected inelasticity-result flux central values define the fourth simulated spectrum used for expected rates."}],"review_version":1}