{"id":"c94a3ab9-f1c1-4710-8590-8c21a25f5546","arxiv_id":"2501.18860","paper_version":2,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":7,"one_line_summary":"The ALP parameter constraints derived from Mrk 501 gamma-ray spectra vary by orders of magnitude depending on whether the jet emission is leptonic or hadronic and on the jet magnetic field geometry.","lead":"This paper calculates how strongly axion-like particles (ALPs) could mix with gamma-ray photons traveling from the blazar Mrk 501 to Earth. It finds that the assumed jet emission model, leptonic or hadronic, and the assumed jet magnetic field geometry change the resulting ALP limits dramatically.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Helical+tangled BJMF parameters are fixed at a single point in their quoted ranges, so the paper's claim that magnetic-field structure matters is not yet robust.","rationale":"The reader's verdict is conditional, and the reader's weakest-assumption analysis already points at the helical+tangled parameters. I agree that this is the most load-bearing issue for the paper's full central claim, because the abstract and conclusion assert that the BJMF structure plays a significant role, and that assertion is precisely the one that depends on (α,r_T,f). The hadronic-vs-leptonic separation is driven by B0 (0.029 G vs 3 G) and would survive moderate variations in B0; the field-structure claim, however, can in principle be erased by choosing other allowed values of the helical+tangled parameters. The paper honestly discloses the fixed choice, but it does not quantify the resulting systematic band, so the four separate contours in Fig. 4 cannot be read as a robust statement about the role of the field model. The proposed corner scan is a finite, computationally cheap check that would settle whether the adopted point is representative. If the scan shows stable separation, the paper's central claim is supported and the current condition can be lifted; if not, the conclusion needs to be weakened to a statement about the specific adopted magnetic-field configuration.","tokens_in":12437,"tokens_out":13234,"duration_ms":138786,"concrete_test":"Using gammaALPs, recompute the 95% CL contours for the helical+tangled BJMF model at the extrema of the quoted ranges: (α,r_T,f)=(0.2,0.1 pc,0), (0.2,10 pc,0.7), (1.5,0.1 pc,0), and (1.5,10 pc,0.7), in addition to the adopted (1,0.3 pc,0.3), for both leptonic and hadronic B0. Then compare each contour to the corresponding toroidal-model contour. If any corner contour overlaps the toroidal contour or the hadronic-vs-leptonic ordering changes, the central claim that the BJMF structure significantly changes the ALP constraints is conditional on the unvaried parameters; if all corner contours remain separated by a similar margin as the adopted point, the claim is robust.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The strongest claim that 'magnetic field structure plays a significant role' is supported only by contours computed at a single, arbitrarily chosen point in the helical+tangled model: α=1, r_T=0.3 pc, f=0.3 (Sec. 5). The paper itself quotes allowed ranges α∈[0.2,1.5], r_T∈[0.1,10] pc, f∈[0,0.7] from Ref. [48] but does not scan them. The qualitative difference between the toroidal and helical+tangled constraints is explained by the field strength at r>1 pc (Fig. 2 and Sec. 5), but this difference is controlled by exactly those three free parameters. In particular, f near 0 gives a purely helical field whose transverse component before the transition at r_T is suppressed, and r_T near 10 pc delays the poloidal-to-toroidal transition; either can bring the helical+tangled profile much closer to the toroidal profile. The paper explicitly acknowledges the uncertainty ('Given the uncertainty in precisely determining these parameters, we adopt specific values...'), yet no contour or bound is shown for any other point in the parameter space. If the adopted point is not representative, the claimed role of the magnetic field structure is not established.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper studies ALP-photon oscillations in the high-energy gamma-ray spectrum of the blazar Mrk 501, using Fermi-LAT and MAGIC data from 2017-06-17 to 2019-07-23. The authors compare two emission scenarios for the spectral energy distribution (leptonic and hadronic) and two jet magnetic field models (toroidal and helical+tangled). The magnetic field strength in the emission region is taken from multi-wavelength fitting: the leptonic scenario is fitted in this work with agnpy, while the hadronic scenario parameters are imported from a previous MAGIC analysis. The ALP-photon propagation is computed with gammaALPs, and 95% C.L. constraints on the ALP mass and coupling are derived using the CLs method. The main reported result is that the hadronic scenario yields much more stringent constraints than the leptonic scenario, reaching roughly g_aγ ~ 2.5e-13 GeV^-1 for m_a ~ 4e-9 eV, and that the choice of magnetic field model also affects the constraints.","tokens_in":12679,"tokens_out":3837,"duration_ms":37145,"significance":"If the results are robust, they provide new ALP constraints from a well-observed blazar and, more importantly, demonstrate that the assumed jet emission scenario and magnetic field geometry can change the derived ALP limits by about an order of magnitude or more. This is a useful contribution to the ALP literature because it quantifies model dependence in a specific source. The use of public data and codes (Fermi-LAT, MAGIC, gammaALPs) and the adoption of the CLs method (rather than naive Wilks' theorem) are methodological strengths. However, the central claim about the role of magnetic field structure is currently supported by only a single point in the helical+tangled parameter space, so the significance of that claim is not yet established.","major_comments":[{"comment":"The claim that the magnetic field structure plays a significant role in the ALP constraints rests entirely on one adopted point in the helical+tangled model parameter space: α=1, r_T=0.3 pc, f=0.3. The manuscript itself quotes the allowed ranges α∈[0.2,1.5], r_T∈[0.1,10] pc, f∈[0,0.7] from Ref. [48], but no scan or robustness check over these ranges is presented. Since the difference between the toroidal and helical+tangled constraints is attributed to the field strength at r>1 pc (Fig. 2), and since the transverse field profile in the helical+tangled model is controlled by exactly these three parameters, a different point in the quoted parameter space could reduce or remove the claimed difference. The sentence 'Given the uncertainty in precisely determining these parameters, we adopt specific values' acknowledges the issue but does not resolve it. I request a robustness scan, or at least extremal cases (e.g., f→0, r_T→10 pc), to establish whether the qualitative conclusion is stable.","section":"Sec. 3, Table 1"},{"comment":"This is a load-bearing issue for the central comparison between leptonic and hadronic scenarios.","section":"Sec. 3, Table 1"}],"minor_comments":[{"comment":"There are several typos: 'and and back' in the introduction, 'milit-wavelength' in the introduction, 'to to ascertain' in the conclusion, and 'The is equation... V on Neumann-like' in Sec. 2.1.","section":"General"},{"comment":"The CLs method is referenced to Ref. [41] but the specific implementation (e.g., number of toy experiments, treatment of nuisance parameters) is not described in the text. Since CLs is central to the statistical analysis, a brief summary or at least a statement of the adopted confidence level construction would improve reproducibility.","section":"Sec. 4"},{"comment":"The heat maps and black contour lines in Fig. 4 are difficult to read in places, especially in the hadronic panels where the χ2 structure is highly oscillatory. Consider showing the contours on a separate panel or using a different color scale.","section":"Fig. 4"},{"comment":"The conclusion that the magnetic field structure 'plays a significant role' is qualitative. A quantitative statement—for example, the maximum difference in excluded g_aγ between the two B-field models at a given mass—would strengthen the claim.","section":"Sec. 5"}],"recommendation":"major_revision","confidential_remarks":"The stress-test concern about the fixed helical+tangled parameters is valid and, in my view, the main obstacle to publication. The paper is otherwise within the scope of JCAP and the methodology is generally sound. The authors should be asked to provide a robustness scan over the helical+tangled parameters and to clarify the treatment of the hadronic B0 uncertainty. No concerns about novelty or citation practices."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"You should know this is a competent ALP analysis with a useful new result and one structural caveat that the authors flag but do not fully address. They apply both leptonic and hadronic emission scenarios and two jet B-field models to Mrk 501 data (MAGIC plus Fermi-LAT, 2017-2019) and produce new 95% CL exclusion contours. The hadronic scenario gives a strong bound down to g_aγ about 2.5e-13 GeV^-1 at m_a around 4e-9 eV, roughly an order of magnitude stronger than the leptonic scenario. That difference is robust because it is driven by B0 differing by two orders of magnitude. The method is sound: gammaALPs, CLs instead of Wilks, public data, and standard treatment of EBL and Galactic magnetic field.\n\nThe soft spots are quantitative, not fatal. The helical+tangled model parameters alpha=1, r_T=0.3 pc, f=0.3 are fixed at a single point within the quoted allowed ranges (alpha 0.2-1.5, r_T 0.1-10 pc, f 0-0.7). The claim that magnetic field structure changes the limits rests almost entirely on that choice. If f is near zero or r_T large, the helical+tangled profile converges to the toroidal one, and the difference may vanish. The authors acknowledge the uncertainty but do not scan the parameter space or show systematic bands. Also, the hadronic B0 is imported from a previous MAGIC fit rather than re-derived, and no uncertainties on B0, R, or delta_D are propagated into the limits. None of this breaks the hadronic-vs-leptonic conclusion, but it makes the contours conditional.\n\nThe paper is honest about its limitations and the citation coverage is adequate. I would send it to a serious referee, asking for a robustness scan over the helical+tangled parameters and a systematic band before acceptance. It deserves referee time because the question it asks is real and the new hadronic-scenario constraint is a meaningful addition to the ALP parameter space.","headline":"A solid ALP limit update for Mrk 501, but the magnetic-field-structure comparison rests on a single point in a wide parameter space; the hadronic vs leptonic gap is the robust part.","tokens_in":13297,"tokens_out":2462,"would_cite":true,"duration_ms":25066,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Mrk 501 axion limit tightens tenfold if its jet is hadronic.","keywords":["axion-like particles","ALP-photon oscillations","blazar Mrk 501","jet magnetic field models","leptonic and hadronic emission scenarios","gamma-ray spectral irregularities","Fermi-LAT","MAGIC"],"falsifier":"Re-run the four $\\chi^2$ scans with $\\alpha$ varied over 0.2 to 1.5, $r_T$ over 0.1 to 10 pc, and $f$ over 0 to 0.7, using the same Fermi-LAT and MAGIC spectral bins and the same gammaALPs propagation; if the hadronic toroidal contour no longer reaches $g_{a\\gamma}\\sim 2.5\\times 10^{-13}\\,\\mathrm{GeV}^{-1}$ at $m_a\\sim 4\\times 10^{-9}$ eV, the paper's headline result is not robust to the model choice.","tokens_in":12180,"feed_emoji":"🌌","tokens_out":6335,"duration_ms":58859,"temperature":0.7,"pith_summary":"This paper is trying to establish that the constraints astrophysical gamma-ray observations place on axion-like particles are not set by the data alone: they depend on which physical model describes the blazar's emission and which magnetic field structure is assumed inside its jet. Using the 2017-2019 Fermi-LAT and MAGIC spectrum of Mrk 501, the authors show that a hadronic emission scenario, with a magnetic field about two orders of magnitude stronger than a leptonic one, excludes ALP-photon couplings down to roughly $g_{a\\gamma} \\sim 2.5\\times 10^{-13}\\,\\mathrm{GeV}^{-1}$ at $m_a\\sim 4\\times 10^{-9}\\,\\mathrm{eV}$, while the leptonic scenario gives much weaker limits. It also shows that a toroidal jet field and a helical+tangled field produce different exclusion regions, especially beyond about 1 pc from the central black hole. The point of the exercise is that ALP searches from blazars inherit the full uncertainty of blazar emission modeling.","feed_headline":"Mrk 501 axion limit tightens tenfold if its jet is hadronic","feed_subtitle":"Fermi-LAT and MAGIC spectra show the assumed jet model changes the excluded axion-photon coupling.","key_machinery":"The machinery is the ALP-photon mixing formalism: a three-state beam $(A_1,A_2,a)$ evolving under the mixing matrix $\\mathcal{M}_0$, whose off-diagonal element $\\Delta_{a\\gamma}=g_{a\\gamma}B_t/2$ drives photon-to-ALP conversion in a transverse magnetic field. The survival probability $P_{\\gamma\\gamma}$ is computed with the density-matrix version of the propagation equation using the gammaALPs package, after propagating through the jet, extragalactic space (with EBL absorption), and the Galactic magnetic field. The other load-bearing ingredient is the multi-wavelength SED fit: the leptonic and hadronic models fix different emission-region field strengths $B_0$, and the two jet field models (toroidal $B\\propto r^{-1}$, and helical+tangled with parameters $\\alpha$, $r_T$, and $f$) set how that field extends along the jet. Constraints are obtained by a $\\chi^2$ scan over $(m_a,g_{a\\gamma})$ with the CLs method, because the non-linear ALP spectral distortions make Wilks' theorem inapplicable.","core_discovery":"The central claim is that Mrk 501's gamma-ray spectrum, which is equally well described by a leptonic and a hadronic one-zone model, already excludes new regions of ALP parameter space, and the exclusion strength is controlled by the assumed emission scenario and jet magnetic field structure. Under the hadronic scenario with a toroidal jet field the constraints are most stringent, reaching $g_{a\\gamma}\\approx 2.5\\times 10^{-13}\\,\\mathrm{GeV}^{-1}$ for $m_a\\approx 4.0\\times 10^{-9}\\,\\mathrm{eV}$. The hadronic scenario's much larger emission-region magnetic field ($B_0=3$ G versus $0.029$ G in the leptonic case) strengthens ALP-photon mixing and therefore sharpens the limits. The toroidal and helical+tangled jet field models give visibly different exclusion contours, with the toroidal model being more restrictive at high ALP masses ($m_a\\sim 10^{-7}{-}10^{-6}$ eV), because the transverse field strengths differ by nearly an order of magnitude for distances $r>1$ pc.","pith_inferences":["The paper fixes the helical+tangled model at $\\alpha=1$, $r_T=0.3$ pc, and $f=0.3$; if the full ranges quoted from the simulation literature were scanned, the toroidal-versus-helical+tangled difference could shrink, move, or disappear at some parameter combinations.","A natural extension would be to apply the same treatment to other high-synchrotron-peaked blazars with both leptonic and hadronic SED fits; sources with stronger hadronic $B_0$ values would be expected to give proportionally stronger ALP limits.","Because the hadronic constraints become nearly mass-independent below $m_a\\sim 10^{-9}$ eV (where the QED term dominates the mixing matrix), low-mass ALP searches using hadronic blazar models may be limited mainly by the coupling reach of the spectrum, not by the ALP mass.","The leptonic-scenario constraints being weaker means that published blazar ALP limits that assume only leptonic emission may underestimate the excluded region if nature is hadronic, and may overstate it if the magnetic field is weaker than assumed."],"forward_implications":["If the hadronic scenario for Mrk 501 is correct, its current Fermi-LAT and MAGIC data already complement dedicated ALP searches such as CAST in the mass range near $10^{-9}$ eV.","Future very-high-energy observations by LHAASO or CTA should sharpen the hadronic-scenario contours further, since the same method benefits from more precise spectral measurements.","If neutrino observations show Mrk 501's high-energy emission is leptonic rather than hadronic, the corresponding ALP constraints would weaken by roughly an order of magnitude, so the ALP limit and the blazar emission model are inseparable.","The difference between toroidal and helical+tangled jet field models means that ALP constraints from blazars carry a systematic uncertainty from jet magnetic field structure that is comparable in size to the statistics of the gamma-ray data."],"supporting_citations":[{"why":"Supplies the Mrk 501 multi-wavelength SED data and the leptonic and hadronic model fits that set the emission-region magnetic field.","marker":"[47]"},{"why":"Supplies the helical+tangled jet magnetic field model and the parameter ranges quoted for $\\alpha$, $r_T$, and $f$.","marker":"[48]"},{"why":"Provides the gammaALPs package used to compute the photon survival probability $P_{\\gamma\\gamma}$.","marker":"[64]"},{"why":"Provides the fiducial Galactic magnetic field model used in the propagation calculation.","marker":"[61]"},{"why":"Provides the Fermi-LAT NGC 1275 ALP constraint shown as a comparison curve.","marker":"[26]"},{"why":"Provides the earlier Mrk 421 leptonic analysis that motivates varying $B_0$ and using the CLs method for ALP constraints.","marker":"[43]"},{"why":"Provides the CAST laboratory constraint used as a comparison curve.","marker":"[76]"},{"why":"Provides the Mrk 421 ARGO-YBJ and Fermi-LAT constraints used for comparison.","marker":"[40]"}],"fun_headline_variants":["Hadronic jet model tightens Mrk 501 axion limits tenfold","Mrk 501 axion exclusion is a factor of ten stronger for hadronic jets","Jet magnetic field geometry decides Mrk 501 axion limits","Hadronic emission scenario squeezes Mrk 501 axion parameter space","Mrk 501 axion constraints vary with jet composition and field model"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The key assumption is that one representative set of helical+tangled jet magnetic field parameters ($\\alpha=1$, $r_T=0.3$ pc, $f=0.3$) captures the difference between jet field models, even though the paper itself quotes wide allowed ranges for these parameters.","fun_headline_variants_meta":{"raw":{"variants":["Hadronic jet model tightens Mrk 501 axion limits tenfold","Mrk 501 axion exclusion is a factor of ten stronger for hadronic jets","Jet magnetic field geometry decides Mrk 501 axion limits","Hadronic emission scenario squeezes Mrk 501 axion parameter space","Mrk 501 axion constraints vary with jet composition and field model"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000645,"raw_usage":{"total_tokens":3012,"prompt_tokens":1039,"completion_tokens":1973,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":655,"completion_tokens_details":{"reasoning_tokens":1875}},"tokens_in":655,"tokens_out":1973,"duration_ms":15864,"temperature":1.0,"reasoning_tokens":1875,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-09T22:11:59.589667+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-run the four $\\chi^2$ scans with $\\alpha$ varied over 0.2 to 1.5, $r_T$ over 0.1 to 10 pc, and $f$ over 0 to 0.7, using the same Fermi-LAT and MAGIC spectral bins and the same gammaALPs propagation; if the hadronic toroidal contour no longer reaches $g_{a\\gamma}\\sim 2.5\\times 10^{-13}\\,\\mathrm{GeV}^{-1}$ at $m_a\\sim 4\\times 10^{-9}$ eV, the paper's headline result is not robust to the model choice.","supporting_citations":[{"cited_title":"Multi-messenger characterization of Mrk 501 during historically low X-ray and $\\gamma$-ray activity","cited_arxiv_id":"2210.02547","evidence_quote":"Supplies the Mrk 501 multi-wavelength SED data and the leptonic and hadronic model fits that set the emission-region magnetic field."},{"cited_title":"Impact of Parameters in the Blazar Jet Magnetic Field Model on Axion-Like Particle Constraints","cited_arxiv_id":"2407.20118","evidence_quote":"Provides the earlier Mrk 421 leptonic analysis that motivates varying $B_0$ and using the CLs method for ALP constraints."}],"review_version":1}