{"id":"5d084fcf-17e6-4cc1-9fc0-2bda53d68b19","arxiv_id":"2507.10441","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":4,"one_line_summary":"Full-sky UHECR arrival directions remain most correlated with starburst galaxies (4.2 sigma post-trial) after adding Telescope Array data, atmospheric corrections, and a new harmonic-space analysis.","lead":"The Auger and Telescope Array collaborations update full-sky ultra-high-energy cosmic ray anisotropy maps with new data and energy corrections, and introduce a harmonic-space cross-correlation method with galaxy catalogs. The strongest signal is a 4.2 sigma post-trial correlation with starburst galaxies, a continuation of earlier results.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The quoted post-trial significances (4.2σ starburst, up to 3.0σ quadrupole) rest on a trial-factor correction that is asserted in Section 5 but never described, so an under-counted look-elsewhere effect would directly overstate the central claim.","rationale":"The reader's weakest assumption identifies precisely the load-bearing issue: the post-trial significance correction is asserted but not described. My reading of the paper confirms this. The central results—the 4.2σ starburst correlation and the 3.0σ quadrupole—are only as strong as the trial factor that converts pre-trial to post-trial significance. Section 5 gives only a sentence saying the approach is 'most conservative' without specifying whether it includes the energy scan, the multipole scan, and the catalogue multiplicity. Section 4 similarly quotes post-trial significances for the medium-scale analysis without describing the trial correction. This is a genuine soft spot, because the full scan space is large: 49 energy thresholds, up to 20 multipoles, five correlation maps, and four catalogues. An under-counted look-elsewhere effect would directly reduce the claimed significances. I do not see a reason to change the reader's CONDITIONAL verdict: the concern is about missing methodological detail in a proceedings paper, not a demonstrated error. The proposed Monte Carlo test would settle whether the concern lands. I agree with the reader that the unexplained large upper uncertainty on the starburst best-fit f is a secondary issue, but the trial-factor calibration is the more load-bearing threat to the central claim.","tokens_in":16834,"tokens_out":2618,"duration_ms":33234,"concrete_test":"Run a full Monte Carlo trial-factor calculation: generate at least 10^4 isotropic full-sky realizations with the same Auger+TA exposure and energy-dependent selection; for each realization, perform the complete analysis scan—all energy thresholds from 32 to 80 EeV in 1 EeV steps, all multipoles ℓ = 1 to 20, both auto- and cross-correlations, and all four galaxy catalogues—and record the global maximum test statistic. Compare the observed 4.2σ starburst value and the Table 2 quadrupole significances against the distribution of global maxima. If the observed values correspond to a global p-value below the quoted post-trial significance (e.g., 4.2σ becomes 3σ or lower), the central claim is overstated.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim—a persistent 4.2σ post-trial correlation with starburst galaxies and a statistically significant quadrupole in harmonic cross-correlations—depends entirely on the post-trial significance calibration. Section 5 states: 'we follow the most conservative approach, by taking into account the scan in energy and the measurements of different multipoles up to ℓ = 20.' No method is given for this trial factor: not the number of simulated isotropic skies, not whether the scan over energy thresholds (49 thresholds from 32 to 80 EeV in Section 4), the multipoles up to ℓ = 20, and the four galaxy catalogues (plus the auto-correlation) are all included, and not whether the correction is Monte Carlo or analytic. The same issue applies to Table 1: the intermediate-scale analysis scans energy thresholds and four catalogues, yet the post-trial significances are quoted without stating the trial factor. If the correction accounts only for part of the search space, the look-elsewhere effect is underestimated and the quoted significances are too high. This is not an internal inconsistency, but it is a load-bearing statistical calibration step that the paper does not document. A related red flag is the authors' own admission in Table 1 that the very large upper uncertainties on f and Θ for the starburst catalogue 'are under investigation'; this suggests a flat or degenerate likelihood that could affect the stability of the TS value, although the trial-factor question is the more direct threat to the headline significance.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents updated full-sky analyses of ultra-high-energy cosmic-ray (UHECR) arrival directions using combined Pierre Auger Observatory and Telescope Array data. It includes: (i) an updated large-scale anisotropy analysis with new TA atmospheric corrections; (ii) an extended intermediate-scale correlation analysis with four galaxy catalogs, including energy-loss attenuation; and (iii) a new harmonic-space analysis computing auto- and cross-correlations up to ℓmax=20 while scanning energy thresholds. The main claims are a 4.2σ post-trial correlation with starburst galaxies (unchanged by attenuation), a quadrupole as the most significant multipole in all considered cases, and cross-correlation significances up to 3.0σ post-trial for the all-AGN catalog.","tokens_in":17038,"tokens_out":5385,"duration_ms":62656,"significance":"If the quoted post-trial significances are correct, the results strengthen the evidence for a full-sky starburst-galaxy correlation of UHECRs and introduce a promising harmonic-space method for probing anisotropy patterns at the quadrupole scale. The inclusion of attenuation in the medium-scale analysis is a notable step beyond previous full-sky studies. Strengths include the use of full-sky coverage, careful cross-calibration of the two observatories, and explicit comparison of attenuation-included and attenuation-free results. The main vulnerability is that the statistical calibration that turns pre-trial into post-trial significances is not documented in sufficient detail to be verified.","major_comments":[{"comment":"The post-trial significance calculation is asserted but not described. Section 4 reports one-tailed post-trial significances in Table 1 without any explanation of how the trial factor accounts for the scan over energy thresholds (49 values from 32 to 80 EeV), the four catalogs, and the free parameters f and Θ. Section 5 states that 'we follow the most conservative approach, by taking into account the scan in energy and the measurements of different multipoles up to ℓ=20' but does not specify the number of isotropic simulations, whether the energy catalog and multipole scans are treated jointly, or whether the medium-scale f and Θ searches are included. Without this information the quoted post-trial values (4.2σ in Table 1, 3.0σ in Table 2) cannot be reproduced or independently validated, and this is load-bearing for the paper's central claims.","section":"§4 and §5, Tables 1 and 2"},{"comment":"The attenuation-included starburst fit reports f = 10.6+56.6−3.2 and Θ = 17.6+26.6−4.1, with the paper noting that the large upper uncertainties are 'under investigation'. Such extreme asymmetric uncertainties indicate a flat or degenerate likelihood direction, which can make the maximum TS value and its location unstable. Since the starburst correlation is the headline result, the authors should provide a profile-likelihood scan or another diagnostic to demonstrate that the TS = 27.3 maximum is robust; the no-attenuation starburst line (f = 10.6+4.0−2.7, Θ = 15.0+4.8−2.9, same TS and 4.2σ) appears better behaved, but the attenuation-included fit is used for the harmonic cross-correlations in Table 2 and therefore requires attention.","section":"Table 1, starburst row"},{"comment":"The Gaussian approximation for the isotropic cross-correlation distribution is introduced as an assumption ('to reduce computational time') but is not validated. For ℓ=2 the cross-correlation is an average over only 2ℓ+1 = 5 modes, so the central-limit justification for Gaussianity is weak; inaccuracies in the assumed distribution would propagate directly into the pre-trial p-values and hence the post-trial significances in Table 2. Because isotropic simulations are already being produced, replacing the Gaussian approximation with the empirical distribution of the simulated cross-correlation coefficients would be straightforward and would remove this source of systematic uncertainty.","section":"§5, Cross-correlation significance"},{"comment":"The attenuation model, including composition fractions, injection spectral index, and rigidity cutoff, is the best fit to Auger data from [4] that was used to describe the same starburst correlation. Testing the same catalogs with this model introduces a moderate circularity for the attenuation-included results: the trial factor does not scan over the attenuation parameters, so the reported significances are conditional on a model that was not independently derived. The no-attenuation starburst line in Table 1 provides an important control, but the all-AGN and jetted-AGN harmonic cross-correlation results in Table 2 have no such control. The authors should at least show that varying the attenuation parameters within their quoted uncertainties does not materially change the significances, or explicitly discuss this limitation.","section":"§4 and §5, attenuation model"}],"minor_comments":[{"comment":"The word 'mutipoles' in the post-trial description is a typo and should read 'multipoles'.","section":"§5"},{"comment":"In the sentence 'in the case of the all-galaxy and starburst galaxy catalogues we also shown results', 'shown' should be 'show'.","section":"§4"},{"comment":"The large-scale analysis quotes p-values (e.g., p = 0.011 and p = 0.0041) and converts them to Gaussian sigmas; the conversion convention (one-tailed or two-tailed) should be stated.","section":"§3"},{"comment":"For the loose-cut TA dataset used in the medium-scale and harmonic analyses, the paper notes that atmospheric corrections are not available and that an older energy calibration from [2] is used; it would be helpful to quantify the resulting systematic uncertainty on the energy thresholds and thus on the reported significances.","section":"§2"},{"comment":"The labels in the multipanel figure are small and the panels are dense; enlarging the font and adding panel labels (a), (b), etc. would improve readability.","section":"Figure 4"}],"recommendation":"major_revision","confidential_remarks":"This is a collaboration proceedings paper. The central claims are plausible and the new harmonic-space analysis is a useful contribution, but the post-trial significance calibration (both in Table 1 and Table 2) is underdocumented. If the collaboration has a methods paper describing the trial-factor computation, citing it and outlining the essentials would resolve the main concern. The circularity of the attenuation model is partially mitigated by the no-attenuation starburst control, but the AGN quadrupole cross-correlation result does not have that control. I recommend major revision to require a precise description of the statistical calibration and a validation of the Gaussian approximation."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Briefly: this is a careful, incremental report from the Auger+TA joint working group. What's genuinely new is Section 5, the harmonic-space auto- and cross-correlation with energy scanning, which extends the Urban et al. formalism and gives a per-multipole view of anisotropy. The inclusion of attenuation in the full-sky medium-scale search and the two additional AGN catalogues are natural but well-executed extensions. The TA atmospheric corrections in the large-scale analysis are a real data improvement, even though the dipole/quadrupole shifts stay within previous uncertainties.\n\nThe main caveat is the post-trial significance. The paper says they follow the most conservative approach, taking into account the scan in energy and the different multipoles up to l=20, but gives no procedure: no simulation count, no analytic formula, no list of the search space. The reader cannot verify the 4.2 sigma or the 2.0-3.0 sigma in the harmonic analysis. This is a real gap, but it is a presentation gap in a proceedings format; the collaborations have standard procedures, and I am not accusing them of under-counting. It simply needs to be documented before the result can be used by others.\n\nAlso worth noting: the starburst best-fit with attenuation has a huge upper uncertainty on f and Theta (10.6 +56.6/-3.2), which the authors say is under investigation. That suggests a flat direction in the likelihood, and it should make one cautious about the stability of the TS value, though it does not obviously invalidate the 4.2 sigma.\n\nThe circularity concern is moderate: the attenuation model is fitted to Auger data to describe the same starburst signal, so testing the same catalog with the same model is not fully independent. But this is standard in the field, and the paper is transparent about the model. I do not think it is fatal.\n\nWho should read this: anyone working on UHECR anisotropy or source models; the harmonic-space method is worth understanding. I would bring it to reading group. I would cite it if I worked on full-sky UHECR anisotropy, mainly for the updated dipole/quadrupole and the new cross-correlation method.\n\nRecommendation: yes, it deserves a serious referee. The novel method and the combined dataset are important enough. The referee should ask for the trial-factor computation and a treatment of the flat likelihood in the starburst fit. A journal version that includes those details would be a solid contribution.","headline":"Solid proceedings update with a genuinely new harmonic-space analysis, but the headline 4.2σ rests on a trial-factor correction the paper never spells out.","tokens_in":17802,"tokens_out":2342,"would_cite":true,"duration_ms":26991,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This paper reports that the combined full-sky cosmic-ray dataset still points to starburst galaxies as the most likely sources, at 4.2 sigma post-trial, with a quadrupole pattern visible in every catalogue comparison.","keywords":["ultra-high-energy cosmic rays","full-sky anisotropy","Pierre Auger Observatory","Telescope Array","starburst galaxies","active galactic nuclei","harmonic cross-correlation","quadrupole"],"falsifier":"Re-run the full analysis on isotropic simulated skies with the same exposure, scanning every energy threshold from 32 to 80 EeV, every multipole up to $\\ell=20$, and all four catalogues, and observe whether a quadrupole cross-correlation as strong as the measured one appears in more than 5% of simulations; if it does, the 3.0 $\\sigma$ AGN claim would not be supported by the data.","tokens_in":16550,"feed_emoji":"🌌","tokens_out":8749,"duration_ms":92503,"temperature":0.7,"pith_summary":"Ultra-high-energy cosmic rays arrive nearly isotropically, so any anisotropy in their arrival directions is a clue about where they come from. This paper combines full-sky data from the Pierre Auger Observatory and the Telescope Array, adding new atmospheric corrections and an extra dataset at the highest energies, and reports that the correlation with starburst galaxies remains the strongest at 4.2 sigma post-trial even after accounting for energy losses. The new harmonic-space analysis finds the quadrupole to be the most significant multipole in every catalogue comparison, with the cross-correlation against all AGNs reaching 3.0 sigma post-trial. The authors present the harmonic cross-correlation as a promising tool for future source matching because it is less affected by magnetic-field deflections and catalogue shot noise.","feed_headline":"Starburst-galaxy signal holds up in full-sky cosmic-ray map","feed_subtitle":"The quadrupole correlation with AGNs reaches 3.0 sigma post-trial, a step toward identifying nearby sources.","key_machinery":"The key mechanism is the full-sky spherical-harmonic expansion of both the cosmic-ray map and the galaxy catalogue maps. The auto-correlation $C_\\ell^{\\mathrm{CR\\,CR}}$ and cross-correlation $C_\\ell^{\\mathrm{CR\\,Cat}}$ are computed for every multipole up to $\\ell=20$, and the whole procedure is repeated for energy thresholds from 32 to 80 EeV, so that each multipole's significance is evaluated with a proper scan. The cross-correlation is the decisive device: its noise is the product of independent fluctuations in the two maps, so an appropriate catalogue can reveal structure that the auto-correlation would smear out. The medium-scale likelihood anchors the search with von Mises–Fisher kernels centred on catalogue sources, weighted by flux and an attenuation model fit to Auger data.","core_discovery":"The central claim is that the combined full-sky UHECR sky is not isotropic: it has a dipole, a quadrupole that aligns with the supergalactic plane at the highest energies, and a statistically persistent correlation with the distribution of starburst galaxies and AGNs. Using the latest TA data with daily and yearly atmospheric corrections, the dipole and quadrupole in the highest-energy bin strengthen but remain within statistical uncertainty. The medium-scale likelihood search, now including energy-loss attenuation and two new AGN catalogues, still finds starburst galaxies the most significant at 4.2 $\\sigma$ post-trial. The new harmonic-space analysis, scanning multipoles up to $\\ell=20$ and energy thresholds from 32 to 80 EeV, shows that the quadrupole is the most significant multipole in all cases; its cross-correlation with all AGNs is 3.0 $\\sigma$ post-trial, with starburst galaxies at 2.7 $\\sigma$. These results are presented as the strongest current evidence that the highest-energy cosmic rays trace nearby star-forming galaxies and AGN populations.","pith_inferences":["The harmonic cross-correlation method could be ported to other full-sky messengers, such as neutrino or gamma-ray maps, to search for the same starburst-galaxy and AGN patterns.","A combined analysis that adds the dipole and quadrupole signals, or merges the quadrupole significance across catalogues, may approach the 5 sigma threshold with only modest additional data.","The strengthening dipole and quadrupole at the highest energies, if confirmed, would make the full-sky UHECR map a useful probe of the local distribution of matter within roughly 100 Mpc.","Because the trial-factor treatment is not specified in detail, an independent simulation of the full scan over energy thresholds, multipoles, and catalogues would be the decisive check on whether the AGN quadrupole correlation is real or a fluctuation."],"forward_implications":["The 4.2 sigma starburst correlation, if real, means the highest-energy cosmic rays come preferentially from star-forming galaxies within about 130 Mpc, not from the general galaxy population.","The persistent quadrupole, most significant in every catalogue, points to a large-scale anisotropy along the supergalactic plane that future exposure can measure with more precision.","Since including attenuation mainly boosts the all-galaxy correlation, energy-loss corrections are now part of the full-sky source search rather than an optional refinement.","The harmonic-space cross-correlation gives a new observable, the per-multipole catalogue correlation, that can be tracked as both observatories accumulate data."],"supporting_citations":[{"why":"Previous full-sky analysis whose dipole, quadrupole, and correlation results are updated with the new TA data.","marker":"[2]"},{"why":"Auger strict-cut dataset for large-scale anisotropies and its exposure model.","marker":"[3]"},{"why":"Defines the four galaxy catalogues, source weights, and the attenuation calculation adopted for the medium-scale and harmonic searches.","marker":"[4]"},{"why":"TA loose-cut dataset above 57 EeV that adds 52 events and extra exposure for the medium-scale and harmonic analyses.","marker":"[6]"},{"why":"Cross-calibration of Auger and TA energy scales via the spectrum fit in the common declination band.","marker":"[7]"},{"why":"Best fit to Auger data above the ankle used for the attenuation parameters in the source flux model.","marker":"[8]"},{"why":"Analytic distribution of auto-correlation power spectra used to convert measured $C_\\ell$ into p-values.","marker":"[9]"},{"why":"Shows that harmonic cross-correlation suppresses shot noise when the catalogue has far more sources than events.","marker":"[10]"}],"fun_headline_variants":["Full-sky cosmic rays show quadrupole aligned with AGNs","Ultra-high-energy cosmic rays trace AGN populations","Harmonic analysis links cosmic rays to AGNs at 3 sigma","Starburst galaxies top cosmic-ray source at 4.2 sigma","AGN quadrupole in cosmic-ray sky hits 3.0 sigma post-trial"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The results depend on the post-trial significance correction being correct; the paper states that the scan over energy and multipoles up to $\\ell=20$ is taken into account but gives no details of how the trial factor is computed, so an underestimated correction would shrink the claimed significances.","fun_headline_variants_meta":{"raw":{"variants":["Full-sky cosmic rays show quadrupole aligned with AGNs","Ultra-high-energy cosmic rays trace AGN populations","Harmonic analysis links cosmic rays to AGNs at 3 sigma","Starburst galaxies top cosmic-ray source at 4.2 sigma","AGN quadrupole in cosmic-ray sky hits 3.0 sigma post-trial"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000338,"raw_usage":{"total_tokens":1879,"prompt_tokens":967,"completion_tokens":912,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":583,"completion_tokens_details":{"reasoning_tokens":832}},"tokens_in":583,"tokens_out":912,"duration_ms":9006,"temperature":1.0,"reasoning_tokens":832,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-06T17:30:49.604581+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-run the full analysis on isotropic simulated skies with the same exposure, scanning every energy threshold from 32 to 80 EeV, every multipole up to $\\ell=20$, and all four catalogues, and observe whether a quadrupole cross-correlation as strong as the measured one appears in more than 5% of simulations; if it does, the 3.0 $\\sigma$ AGN claim would not be supported by the data.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Previous full-sky analysis whose dipole, quadrupole, and correlation results are updated with the new TA data."},{"cited_title":"Tinyakov et al","cited_arxiv_id":null,"evidence_quote":"Cross-calibration of Auger and TA energy scales via the spectrum fit in the common declination band."},{"cited_title":"Likelihood methods for the combined analysis of CMB temperature and polarisation power spectra","cited_arxiv_id":"astro-ph/0604547","evidence_quote":"Analytic distribution of auto-correlation power spectra used to convert measured $C_\\ell$ into p-values."},{"cited_title":"Detecting ultra-high energy cosmic ray anisotropies through cross-correlations","cited_arxiv_id":"2005.00244","evidence_quote":"Shows that harmonic cross-correlation suppresses shot noise when the catalogue has far more sources than events."}],"review_version":1}