{"id":"a5d2d88d-28f8-4987-aa28-d083a79b8b3b","arxiv_id":"1909.01171","paper_version":1,"verdict":"UNVERDICTED","confidence":"MODERATE","novelty_score":2.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":2,"one_line_summary":"A VERITAS work-in-progress report projects that 2,100 hours of archival data will tighten the primordial black hole evaporation rate-density upper limit by about a factor of two, down to roughly 10^4 pc^-3 yr^-1.","lead":"This paper from the VERITAS collaboration reports that using about 2,100 hours of archival gamma-ray data, instead of 750 hours, should improve the limit on how often primordial black holes evaporate nearby. The work is still in progress, so the paper presents an expected improvement, roughly a factor of two, rather than a measured result.","discovery_kind":"unclear","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The factor-of-two projected limit in Sec. 5 is not derived from Eqs. (5.1)-(5.4); no effective-volume, background, or Poisson-limit calculation is shown, so the one quantitative claim is uncheckable as presented. UNVERDICTED is the appropriate disposition.","rationale":"The reader's verdict UNVERDICTED is correct: the paper is a conference progress report with no final result. I agree with the reader that Eq. (5.1) is an unvalidated input, but the more immediate blocker is that no limit-setting calculation is shown at all, so even the old-limit-to-new-limit ratio cannot be checked. The self-reported 'work in progress' status is not a defect, but it confirms that the central quantitative claim is a projection. No internal contradiction is apparent; the appropriate action is to keep the paper unverdictable until the completed analysis is released.","tokens_in":5842,"tokens_out":10377,"duration_ms":102700,"concrete_test":"Reproduce the quoted Dataset I limit (2.22e4 pc^-3 yr^-1) from Eqs. (5.1)-(5.4) with 747 h livetime; if it reproduces, recompute the expected 99% CL limit for the full 2050 h (Dataset I+Dataset II) using the post-upgrade effective area and the new PSF/likelihood cuts from Sec. 3. If the resulting limit is not within ~20% of ~1e4 pc^-3 yr^-1, the factor-of-two projection is not supported by the paper's own formalism.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The only quantitative claim is the Section 5 sentence: 'The new limit, which is still a work in progress, is expected to be a factor of two more constraining from the previous limit, at a value of about 10^4 pc^-3 yr^-1.' The paper's earlier formalism (Eqs. 5.1-5.4) would generate such an expectation, but no numerical inputs or outputs are provided: no N_gamma values, no V_eff, no background estimates, no 99% CL calculation. The projected improvement therefore rests on an unshown scaling from 747 h (Dataset I) to 2050 h (Dataset I+II) and on the post-2012 lower threshold, whose effect on signal efficiency and background rate is only described qualitatively. The model spectrum in Eq. (5.1) is taken from Milagro [7] and is not cross-checked against VERITAS data; if its normalization or spectral slope is off, the effective-volume ratio between datasets changes. The paper itself flags 'This work is still in progress' (abstract and Sec. 5), so this is an explicitly preliminary expectation rather than a hidden flaw. But because the central claim is exactly that expectation, and it is not derivable from the text, the paper cannot be verified or falsified as written. That is the load-bearing gap.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"This manuscript reports an ongoing VERITAS search for gamma-ray bursts from evaporating primordial black holes, using archival data taken between 2009 and 2017. The data are divided into Dataset I (~750 h, pre-upgrade) and Dataset II (~1300 h, post-upgrade), and the paper describes the preparation of Dataset II: calibration of the point-spread function, a likelihood-based discrimination between real bursts and background coincidences, and a background-estimation method based on time scrambling. The only quantitative result appears in Section 5, where the authors state, as a work in progress, that the new upper limit on the local PBH evaporation rate density is expected to be about a factor of two more constraining than the previous limit of 2.22e4 pc^-3 yr^-1, i.e. about 1e4 pc^-3 yr^-1.","tokens_in":6091,"tokens_out":4918,"duration_ms":49442,"significance":"If the projected factor-of-two improvement were demonstrated, it would update the strongest VERITAS constraint on the local PBH evaporation rate density and would illustrate the benefit of the post-upgrade lower energy threshold. The methodological framework—Poisson effective volume, likelihood cuts, and time-scrambled background estimation—is standard and credible, and the paper is clear that this is an expected rather than final result. However, the paper's central quantitative claim is not backed by any numerical analysis in the manuscript: no N_gamma values, no effective volume, no background rates, no 99% confidence-level calculation, and no systematic uncertainties are presented. The manuscript therefore cannot be verified or falsified as written, and its significance as a research paper is currently limited to a status report.","major_comments":[{"comment":"The central quantitative claim—'The new limit, which is still a work in progress, is expected to be a factor of two more constraining from the previous limit, at a value of about 10^4 pc^-3 yr^-1'—is not derivable from Eqs. (5.1)-(5.4) as presented. The text provides no numerical values for N_gamma, no effective volume V_eff, no estimate of the background burst rate, and no calculation of the 99% confidence-level limit. Consequently, the factor-of-two improvement cannot be checked from the manuscript. Please show the actual projected-limit calculation, or state explicitly the scaling assumption (e.g., from 747 h of Dataset I to the total exposure) and the resulting uncertainty.","section":"Sec. 5"},{"comment":"The projected limit rests on the time-integrated PBH spectrum borrowed from Milagro [7], with kT_tau = 7.8 (tau/1s)^(-1/3) TeV. This spectrum determines the expected photon number N_gamma and hence the effective volume in Eq. (5.3); the manuscript neither validates this spectrum against VERITAS data nor quantifies the systematic uncertainty in its normalization or slope. The impact of plausible variations in this model on the projected limit should be estimated, or at least discussed.","section":"Sec. 5, Eq. (5.1)"},{"comment":"It is not stated whether the sigma values in Table 1 are for Dataset II only, for the combined dataset, or for both. The text says that the angular resolution must be re-evaluated for Dataset II, while Dataset I uses the values from [9], but the table caption merely says the fit is done 'using Crab data.' This ambiguity matters because the likelihood function in Eq. (3.2) and the effective volume in Eq. (5.3) depend directly on these sigma values.","section":"Sec. 3.1, Table 1"}],"minor_comments":[{"comment":"The exposure for Dataset I is quoted as '750 hours' in the abstract and Section 3, but Section 5 uses '747 hours'; these numbers should be harmonized.","section":"Abstract, Sec. 3, Sec. 5"},{"comment":"Section 3 states the total exposure is 'about 2100 hours', but the quoted components are approximately 750 + 1300 = 2050 hours; please correct or clarify which total is intended.","section":"Sec. 3"},{"comment":"The text and figure caption contain the typo 'centriod' for 'centroid' in two places.","section":"Sec. 3.2, Fig. 2"},{"comment":"The last row of Table 1 is labeled 'Eenergy' in one column; it should read '(1.0-50 TeV)' to match the other bins.","section":"Table 1"},{"comment":"The piecewise definition in Eq. (5.1) is typeset in a way that may confuse readers; the conditions 'for E_gamma < kT_tau' and 'for E_gamma >= kT_tau' should appear explicitly on each branch, and the unmatched curly brace should be fixed.","section":"Sec. 5, Eq. (5.1)"},{"comment":"Reference [6] contains a stray 'and.' after the author name 'G Teši´c'; this should be corrected.","section":"References"}],"recommendation":"major_revision","confidential_remarks":"This manuscript is essentially a conference status report. For a journal submission, the missing quantitative analysis is a blocking issue; the paper would need to include at least the projected limit calculation with numerical inputs and systematic uncertainties. If the intended venue explicitly accepts preliminary/status contributions, the present form may be acceptable, but under standard journal criteria a major revision is needed."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Read the ICRC paper. Short version: it's a status report, and it says so itself. The only quantitative claim is in Sec. 5: combining 747 h of old data with ~1,300 h of post-upgrade data should tighten the PBH evaporation rate-density upper limit from 2.22e4 to about 1e4 pc^-3 yr^-1. That's a nice prospect, not a result. No burst counts, no effective volume, no limit calculation, no systematics. So I agree with the reader's UNVERDICTED tag: there is nothing for a referee to check as a measurement.\n\nWhat is actually new: the paper re-fits the VERITAS PSF from Crab data after the 2012 camera upgrade, in elevation/energy bins, and gives the sigma values in Table 1. That is a small but real piece of calibration work, and it is needed if the old search method is to be applied to the new data. The paper also describes the dataset and the likelihood/burst-search chain clearly and cites the earlier methodology properly. The honesty is a point in its favor: the abstract says 'work in progress', and Sec. 5 says the new limit is 'expected', not measured.\n\nSoft spots, in proportion: the projected factor-of-two is plausible from the exposure growth (750 to ~2,100 h) plus the lower threshold, but the text doesn't connect Eqs. (5.1)-(5.4) to that number. There is no effective-volume ratio shown and no calculation of how the 90% likelihood retention cut and the lower threshold change signal efficiency. The Milagro time-integrated spectrum in Eq. (5.1) is load-bearing and is not cross-checked against VERITAS data. That's normal for this field, but it means the factor-of-two is best read as an expectation, not a derived result.\n\nBottom line: this is a legitimate conference status report and I'd take it as one. For a journal submission, I'd desk reject until the analysis is complete. No one should cite the 1e4 number as a measurement. If the final paper delivers the actual limit and effective volumes, it will be worth a proper referee.","headline":"A clean, honest status report from VERITAS with one projected number and no final measurement; it belongs in conference proceedings, but not in a journal until the analysis is finished.","tokens_in":6646,"tokens_out":2659,"would_cite":false,"duration_ms":27935,"reading_group":"no","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Adding 1,300 hours of newer VERITAS data should halve the upper limit on how often primordial black holes evaporate in our local neighborhood.","keywords":["primordial black holes","Hawking radiation","gamma-ray bursts","VERITAS","evaporation rate density","upper limit","very-high-energy gamma rays","atmospheric Cherenkov telescopes"],"falsifier":"Complete the burst search on the full 2,100-hour dataset and compare the resulting 99% confidence upper limit with $2.22\\times10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$; if it is not close to half that value, about $10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$, the paper's central projection fails. Independently, recompute the effective volume with a differently derived time-integrated Hawking spectrum, for example from a full particle-physics evaporation code, and check whether the limit shifts by more than the quoted factor of two.","tokens_in":5586,"feed_emoji":"🕳️","tokens_out":11376,"duration_ms":95969,"temperature":0.7,"pith_summary":"This paper reports work in progress: adding roughly 1,300 hours of VERITAS observations taken after the 2012 camera upgrade to the earlier 750-hour dataset is expected to tighten the upper limit on how often primordial black holes evaporate in the local universe, from $2.22\\times10^4$ to about $10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$. This matters because every non-detection of the short gamma-ray burst that Hawking evaporation is predicted to produce narrows the allowed abundance of primordial black holes, and with it the early-universe conditions that could have formed them. The improvement is expected to come from both the larger exposure and the lower energy threshold of the newer data, which makes the array sensitive to more of the burst photons. The analysis uses a likelihood-based burst search, a scrambled-event background estimate, and a time-integrated burst spectrum adopted from the Milagro analysis; the quoted new limit is a projection, not a final measured result.","feed_headline":"New VERITAS data should halve primordial black hole evaporation limit","feed_subtitle":"Projected 99% confidence limit drops to 10,000 per cubic parsec per year, halving the previous bound.","key_machinery":"The load-bearing object is the time-integrated Hawking burst spectrum of Eq. (5.1), $$\\frac{dN_\\gamma}{dE_\\gamma}\\approx 9\\$times10^{{35}}$\\left\\{(1\\,\\mathrm{GeV}/T_\\tau)^{3/2}(1\\,\\mathrm{GeV}/E_\\gamma)^{3/2}\\ \\mathrm{for}\\ E_\\gamma<kT_\\tau;\\ (1\\,\\mathrm{GeV}/E_\\gamma)^3\\ \\mathrm{for}\\ E_\\gamma\\ge kT_\\tau\\right\\},$$ with $kT_\\tau=7.8(\\tau/1\\,\\mathrm{s})^{-1/3}\\,\\mathrm{TeV}$, taken from the Milagro analysis. Convolved with the VERITAS detector response, this spectrum fixes the expected photon count $N_\\gamma$ from a burst at distance $r$, and through the Poisson probability $P(b,N_\\gamma)$ it defines the effective volume $V_{\\mathrm{eff}}$ within which a burst of $b$ photons would be seen. The expected number of bursts is then $n_{\\mathrm{exp}}=\\dot{\\rho}_{\\mathrm{PBH}}\\times T_{\\mathrm{obs}}\\times V_{\\mathrm{eff}}$, so an observed null result bounds the evaporation rate density $\\dot{\\rho}_{\\mathrm{PBH}}$ directly. The other mechanism is the likelihood-ratio burst search: events are grouped in time windows of 1 to 45 seconds, their directions are compared with a modified hyperbolic secant point-spread function whose width parameter $\\sigma$ is re-fitted for the post-2012 camera in four energy and three elevation bins, and the background is estimated by scrambling arrival times ten times.","core_discovery":"On the paper's own terms, the central claim is that applying the established VERITAS burst-search procedure to 2,100 hours of archival data — 747 hours from 2009–2012 plus roughly 1,300 hours from 2012–2017, the latter with a lower energy threshold below 100 GeV — should yield a 99% confidence upper limit on the local rate density of evaporating primordial black holes of about $10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$, a factor of two below the previous VERITAS limit of $2.22\\times10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$. No burst signal has been found in the data examined so far; the paper presents the angular-resolution calibration for the new camera configuration and the likelihood cuts that will separate real bursts from chance coincidences, then uses the time-integrated Hawking spectrum of Eq. (5.1) to convert the null result into a rate-density bound. The factor-of-two improvement is the paper's central projection and is explicitly labeled as work in progress.","pith_inferences":["If the true rate density were close to the projected limit, the 2,100-hour dataset would be expected to contain only a small number of burst candidates; a search that finds zero bursts would push the limit below $10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$, while a few candidates would move the field from limit-setting toward detection.","The factor-of-two projection is hostage to the adopted Milagro spectrum; replacing Eq. (5.1) with a spectrum from a full standard-model evaporation calculation could shift the effective volume, and hence the limit, by more than the quoted statistical factor, so the final limit should be read as model-dependent.","Because the post-2012 threshold reaches below 100 GeV, the combined search is sensitive to a slightly earlier part of the final burst than the 2009–2012 analysis; correlating the limit with the assumed remaining-lifetime window $\\tau$ could separate the effect of added exposure from the effect of the new energy reach.","The same effective-volume method transfers to next-generation instruments with larger collecting area, where the same burst-search logic would scale to proportionally tighter limits without any change to the analysis machinery."],"forward_implications":["If the final analysis confirms the projection, the 99% confidence upper limit on the local PBH evaporation rate density becomes about $10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$, halving the previous VERITAS bound.","At that level the VERITAS limit would sit below the $1.4\\times10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$ H.E.S.S. limit quoted in the introduction, making the 2,100-hour combined dataset the most sensitive of the searches listed there.","The lower energy threshold of the post-2012 data contributes to the improvement independently of exposure, because it lets the search count lower-energy photons from the burst spectrum.","A null result in the final search would leave the predicted Hawking-radiation burst undetected and further compress the allowed abundance of $10^{15}$ gram primordial black holes."],"supporting_citations":[{"why":"Supplies the time-integrated burst spectrum of Eq. (5.1) and the effective-volume methodology that turns a null burst search into a rate-density limit.","marker":"[7]"},{"why":"Provides the previous VERITAS limit of $2.22\\times10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$ from 747 hours of Dataset I and the likelihood burst-search methodology reused here.","marker":"[9]"},{"why":"Gives the H.E.S.S. 30-second-window limit of $1.4\\times10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$, the comparison point the projected VERITAS limit would beat.","marker":"[8]"},{"why":"Defines the time-scrambling procedure used to estimate the background rate of chance-coincidence bursts.","marker":"[12]"},{"why":"Provides the boosted decision tree gamma/hadron separation used to build the gamma-like event sample.","marker":"[11]"},{"why":"Establishes Hawking radiation as the physical mechanism that produces the predicted gamma-ray burst.","marker":"[5]"}],"fun_headline_variants":["VERITAS data expected to halve primordial black hole limit","Expanded VERITAS search may halve PBH evaporation limit","Projected 2x tighter VERITAS bound on PBH evaporation","New VERITAS archive could halve black hole evaporation rate"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The projected limit assumes the time-integrated Hawking burst spectrum of Eq. (5.1), taken from the Milagro analysis, correctly predicts how many gamma-ray photons a dying primordial black hole emits; if that spectrum is wrong, the effective volume changes and the computed upper limit moves by an amount the paper does not quantify.","fun_headline_variants_meta":{"raw":{"variants":["VERITAS data expected to halve primordial black hole limit","Expanded VERITAS search may halve PBH evaporation limit","Projected 2x tighter VERITAS bound on PBH evaporation","New VERITAS archive could halve black hole evaporation rate"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000285,"raw_usage":{"total_tokens":1719,"prompt_tokens":1025,"completion_tokens":694,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":641,"completion_tokens_details":{"reasoning_tokens":620}},"tokens_in":641,"tokens_out":694,"duration_ms":6545,"temperature":1.0,"reasoning_tokens":620,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T05:24:56.103841+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Complete the burst search on the full 2,100-hour dataset and compare the resulting 99% confidence upper limit with $2.22\\times10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$; if it is not close to half that value, about $10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$, the paper's central projection fails. Independently, recompute the effective volume with a differently derived time-integrated Hawking spectrum, for example from a full particle-physics evaporation code, and check whether the limit shifts by more than the quoted factor of two.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the time-integrated burst spectrum of Eq. (5.1) and the effective-volume methodology that turns a null burst search into a rate-density limit."},{"cited_title":"Archambault and VERITAS Collaboration","cited_arxiv_id":null,"evidence_quote":"Provides the previous VERITAS limit of $2.22\\times10^4\\,\\mathrm{pc}^{-3}\\,\\mathrm{yr}^{-1}$ from 747 hours of Dataset I and the likelihood burst-search methodology reused here."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Defines the time-scrambling procedure used to estimate the background rate of chance-coincidence bursts."},{"cited_title":"Improved γ/hadron separation for the detection of faint γ-ray sources using boosted decision trees","cited_arxiv_id":null,"evidence_quote":"Provides the boosted decision tree gamma/hadron separation used to build the gamma-like event sample."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Establishes Hawking radiation as the physical mechanism that produces the predicted gamma-ray burst."}],"review_version":1}