Pith. sign in

REVIEW 5 major objections 6 minor 20 references

Identifying New $\gamma$-Ray Sources in All-Sky Surveys Based on Fermipy's Advanced Algorithm

T0 review · 5 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read An automated all-sky search of 15.41 years of Fermi-LAT data identifies 1379 new gamma-ray sources, 497 of them above 5 sigma.

desk verdict A useful all-sky candidate search undermined by an uncorrected 4-sigma threshold and inconsistent counting; the catalog is worth reviewing after revision. read the letter →

arxiv 2412.18767 v1 pith:FNAK67N5 submitted 2024-12-25 astro-ph.HE

Y.C.Xiang , P.Feng , X.F.Lan This is my paper · ORCID
classification astro-ph.HE
keywords gamma-raysourcesFermi-LATall-skysurveysourcedetectionbinnedlikelihoodTSmap4FGL-XiangcatalogFermipy
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims to have built an efficient, automated all-sky search for GeV gamma-ray sources and to have applied it for the first time to 15.41 years of Fermi-LAT data. The search divides the sky into 72 overlapping $30^\circ\times30^\circ$ regions, uses Fermipy's find_sources() routine to seed and fit candidates with $\mathrm{TS}\ge16$ ($4\sigma$), and collects those not present in 4FGL-DR4 into a new catalog named 4FGL-Xiang. The paper reports 1379 new sources above 500 MeV, with 497 claimed above $5\sigma$; among them are 21 spatially extended sources, 23 sources with spectral curvature above 10 GeV, and 44 variable sources above 1 GeV. If the detections hold, the catalog substantially extends the census of known GeV emitters and shows that automated pipelines can replace laborious visual TS-map inspection for future all-sky searches.

What carries the argument

The load-bearing machinery is Fermipy's GTAnalysis pipeline, in particular the find_sources() method, which builds a TS map over each region, places a point-source model at every pixel exceeding a $\sqrt{\mathrm{TS}}=4.0$ threshold, and fits the resulting model jointly; localize() then refines each candidate position. The all-sky search becomes tractable by tiling the sky into 72 $30^\circ\times30^\circ$ regions derived from the Galactic diffuse emission template, running binned likelihood fits in parallel with all 4FGL-DR4 sources included within $30^\circ$ of each region center, and then removing duplicate candidates found in the overlapping region boundaries. The follow-up classification uses standard 4FGL statistics: $\mathrm{TS}_{\rm ext}>16$ for spatial extension, $\mathrm{TS}_{\rm cur}>16$ for spectral curvature, and $\mathrm{TS}_{\rm var}>21.67$ for variability at 99% confidence.

What would settle it

Run the same 72-region pipeline on scrambled photon maps generated from the best-fit background models and count how many fitted candidates still reach TS at least 16; if the false-positive rate is a few percent or higher, a substantial part of the 1379 new sources, particularly the 886 faint ones between 4 and 5 sigma, would be statistical fluctuations rather than genuine emitters.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that an automated Fermipy pipeline can recover the known 4FGL-DR4 source population and simultaneously reveal thousands of additional gamma-ray candidates without per-candidate visual scanning. The pipeline finds 1379 new sources whose $2\sigma$ error regions do not overlap any 4FGL-DR4 source, and it provides their positions, spectra, significance levels in three energy bands, and variability information. A cross-check on 556 known sources re-analyzed over the same 14-year interval used by 4FGL-DR4 returns significance ratios and energy fluxes consistent with the published catalog, which the paper takes as evidence that the new detections are genuine rather than artifacts of the multi-region fitting scheme.

Load-bearing premise

The catalog rests on the assumption that a candidate with likelihood TS at least 16, selected without any trial correction over the all-sky grid and without Monte Carlo validation, is a real source rather than a background fluctuation.

Editorial extensions

If this is right

  • The 4FGL-Xiang catalog enlarges the gamma-ray source population by 1379 candidates, giving counterpart-search programs a new target list across the whole sky.
  • The three-band significance columns (Sig0.5, Sig1, Sig10) let researchers pick out hard-spectrum candidates without re-running the likelihood analysis.
  • The 21 extended candidates and 23 curved-spectrum candidates above 10 GeV are ready-made samples for follow-up spectral and morphological studies.
  • The 44 variable sources above 1 GeV provide a sample for studying flare mechanisms and searching for quasi-periodic behavior.
  • The method itself implies that future Fermi-LAT catalog increments can be produced automatically and quickly as more data accumulate, instead of through manual TS-map inspection.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A Monte Carlo or scramble test would likely show that some fraction of the 886 sources at 4-5 sigma are spurious, since no trials factor is applied; the paper's true new-source count may therefore be closer to the 5-sigma subset than to 1379.
  • Cross-matching 4FGL-Xiang with radio, X-ray, and neutrino catalogs could reveal whether the faint candidates form a new population of extragalactic emitters or are mostly residual Galactic diffuse fluctuations.
  • The paper's internal count of 1451 sources above 4 sigma in one section versus 1379 in the summary, and 497 versus 508 above 5 sigma, should be reconciled by the authors before the catalog is used for population statistics.
  • The same automated tiling pipeline could be run on 100 MeV data with the appropriate foreground model, or on future survey data, to test whether the 500 MeV energy threshold is what keeps the false-positive rate acceptable.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 6 minor

Summary. The paper presents an automated all-sky search for new gamma-ray sources using Fermipy, dividing the sky into 72 30°x30° regions aligned with the Galactic diffuse emission template, and analyzing 15.41 years of Fermi-LAT data above 500 MeV. The authors report identifying 1379 new sources at >4σ, of which 497 are >5σ, and then characterize 21 extended sources, 23 sources with spectral curvature above 10 GeV, and 44 variable sources above 1 GeV. The method is partially validated by comparing fluxes of known 4FGL-DR4 sources, and the resulting 4FGL-Xiang catalog is released through China-VO.

Significance. If the catalog were reliable, this would be a substantial extension of the 4FGL-DR4 source population and a potentially useful resource for the community. The paper demonstrates a practical parallelized pipeline and makes data products publicly available, which is commendable. However, the statistical validation is insufficient to support the headline number of new sources: the absence of trial correction over the all-sky search means that a large fraction of the faint 4–5σ candidates could be background fluctuations. The internal inconsistencies in the reported source counts further undermine confidence in the catalog. The work would be significant only after the detection threshold is properly calibrated and the counts reconciled.

major comments (5)
  1. [Section 3.2] The detection threshold is set to sqrt_ts_threshold=4.0 (TS=16) with no correction for the large number of spatial trials. With 72 ROIs of 30°x30° at 0.1° binning, the search effectively involves millions of spatial pixels; even after PSF smoothing, the expected number of noise fluctuations with TS≥16 is of order hundreds. The claimed 1379 new sources are therefore not supported as genuine detections without Monte Carlo validation or false-discovery-rate control. This is the central claim of the paper and is load-bearing.
  2. [Abstract, Section 4.1, Section 4.4] The reported number of new sources is internally inconsistent: the abstract and Section 4.4 state 1379, Section 4.1 states 1,451, and the breakdown in Section 4.1 of 886 faint (4–5σ) plus 508 significant (>5σ) sources sums to 1394. The catalog count must be reconciled and the cause of the discrepancies explained, since the headline number is the primary result of the paper.
  3. [Section 4.2] The robustness test only compares flux normalization and significance of known 4FGL-DR4 sources within 5° of ROI centers. It does not test the false-positive rate for new sources, nor does it measure detection efficiency as a function of flux, position, or background level. Consequently it cannot validate the reliability of the 4–5σ population, which is the most noise-contaminated part of the catalog.
  4. [Section 3.2] The duplicate-removal procedure is not reproducible: the manuscript states that duplicates were removed 'utilizing the Excel functionality in WPS' without specifying the matching radius, whether 1σ or 2σ error circles were used, or how sources near ROI boundaries were assigned. This directly affects the final source count and should be specified precisely.
  5. [Section 3.3] The extension analysis uses TS_ext>16 without accounting for the number of tested spatial models and the range of tested radii (0.1°–3.0° in 0.01° increments). This introduces a multiple-testing problem for each of the 1379 sources, which can produce spurious extended-source claims, especially for faint sources. A Monte Carlo or other trial-correction scheme is needed.
minor comments (6)
  1. [Abstract] The abstract contains a typo: 'Fermi p y' should be 'Fermipy'.
  2. [Introduction] The word 'applyed' in Section 2 should be 'applied'.
  3. [Section 4.2] The text uses 'IOR' where 'ROI' is meant; this appears in the first sentence of Section 4.2.
  4. [Figure 1 caption] The caption states the map size as 180°×360°, while the text in Section 3.1 says the sky is 360°×180°. These should be consistent.
  5. [Table 5 caption] The caption reads 'Analysis results of robustness verification', but the table lists column descriptions and units; this caption should be changed to something like 'Description of catalog columns'.
  6. [References] The reference list includes Strong (1977), but this work does not appear to be cited in the text.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the new-source search is an independent likelihood-ratio analysis against a model built from 4FGL-DR4, and the robustness check compares against an external catalog.

full rationale

The paper's central claim—the discovery of 1379 (or 1451) new gamma-ray sources—is produced by a standard likelihood-ratio search: Fermipy's find_sources() adds candidate point sources where the TS map exceeds sqrt_ts_threshold=4.0, using a background and source model built from the independent 4FGL-DR4 catalog. The new sources are not defined in terms of the search output; they are residual excesses after subtracting the 4FGL-DR4 model. The robustness check in Section 4.2 compares the method's fitted significance and energy flux for 556 known 4FGL-DR4 sources against the published 4FGL-DR4 values, which is an external benchmark, not a self-referential validation. No parameter is fitted to a subset and then renamed as a prediction; no uniqueness theorem is imported from the authors' prior work; and the 4σ threshold is a standard convention borrowed from 4FGL, not an ansatz that presupposes the result. The cited prior work by the authors (e.g., Xiang et al. 2021a,b) is used only as examples of higher-energy searches, not as load-bearing justification. The internal inconsistency in source counts (1379 in the abstract and Section 4.4, 1451 in Section 4.1, and 886+508=1394 in Section 4.1) is a factual or bookkeeping error that affects the paper's precision, but it is not a circularity: the numbers do not make the derivation equivalent to its inputs. The absence of explicit trial corrections or Monte Carlo false-positive validation is a statistical robustness concern, not a circularity concern, because the threshold is an input assumption rather than a derived output. Overall, the derivation chain is self-contained with respect to circularity, and the central result has independent content beyond the input model and data.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

All listed choices are hand-picked analysis settings; the detection threshold and the background model accuracy are the most consequential for the central claim. The paper does not introduce new physical entities.

free parameters (5)
  • Detection significance threshold = sqrt_ts_threshold = 4.0 (TS = 16)
    Chosen by hand as the minimum significance for declaring a new source. Directly sets the number of candidates (1379). A lower threshold would add more candidates; a higher one would remove many.
  • Radius for freeing spectral parameters = 5 degrees
    Sources within 5 degrees of each ROI center are fitted freely; outside, they are fixed to 4FGL-DR4 values. This choice affects background model accuracy at ROI edges and hence the detected sources.
  • Low-energy threshold = 500 MeV
    Chosen to mitigate the large point-spread function at low energies; excludes soft sources and changes the candidate set.
  • Spatial extension search range = 0.1 to 3.0 degrees
    Radius/sigma range tested for the Gauss and Disk spatial models; affects which sources are classified as extended in Table 1.
  • Number of time bins for variability = 10
    The light curve is divided into ten bins to compute TSvar; different binning would change the variable-source list.
assumptions (4)
  • domain assumption The likelihood ratio test statistic TS for a point source follows a chi-square distribution with one degree of freedom, so sqrt(TS) can be interpreted as a Gaussian significance.
    Used to set 4 sigma as TS=16 in Section 3.2, inherited from standard Fermi-LAT practice without a trial correction.
  • domain assumption The Galactic diffuse and isotropic templates (gll_iem_v07.fits and iso_P8R3_SOURCE_V3) accurately describe the background when their normalizations are fitted per ROI.
    The detection search treats any residual excess above these templates as a source; template errors would appear as false sources.
  • domain assumption The 4FGL-DR4 catalog, with the stated 30 degree inclusion radius and 5 degree freeing radius, is a complete model of known gamma-ray sources.
    If known sources are mis-modeled, the residual map used by find_sources() would be corrupted.
  • domain assumption Sources found with TS>16 in the global refit are genuine gamma-ray emitters, with no correction for the number of trials.
    The paper states no false-discovery-rate analysis; this is a load-bearing statistical assumption.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Identifying New $\gamma$-Ray Sources in All-Sky Surveys Based on Fermipy's Advanced Algorithm." pith.science (2026). https://pith.science/paper/FNAK67N5

@misc{pith2026241218767,
  author       = {Pith},
  title        = {Pith review of: Identifying New $\gamma$-Ray Sources in All-Sky Surveys Based on Fermipy's Advanced Algorithm},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/FNAK67N5}},
  note         = {Machine review of arXiv:2412.18767}
}
read the original abstract

We employ an efficient method for identifying gamma-ray sources across the entire sky, leveraging advanced algorithms from Fermi p y, and cleverly utilizing the Galactic diffuse background emission model to partition the entire sky into 72 regions,thereby greatly enhancing the efficiency of discovering new sources throughout the sky through multi-threaded parallel computing. After confirming the reliability of the new method, we applied it for the first time to analyze data from the Fermi Large Area Telescope encompassing approximately 15.41yr of all sky surveys. Through this analysis, we successfully identified 1379 new sources with levels exceeding 4sigma, of which 497 sources exhibited higher significance levels exceeding 5sigma. Subsequently, we performed a systematic analysis of the spatial extension, spectra, and light variation characteristics of these newly identified sources. We identified 21 extended sources and 23 sources exhibiting spectral curvature above 10GeV. Additionally, we identified 44 variable sources above 1GeV.

Figures

Figures reproduced from arXiv: 2412.18767 by the authors.

Figure 1
Figure 1. The map is the Galactic diffuse background emission, which had a size of 180 [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
Figure 2
Figure 2. This map is the TS map of the R35 in Figure [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Sky Map of γ-Ray Sources. Red dots represent data from 4FGL-Xiang and blue dots represent data from 4FGL-DR4. 2023, covering 15.41 years. This represents an additional 1.41 years of data compared to the 4FGL-DR4 dataset. (c) Discovery of 1379 new γ-ray sources. Firstly, it is necessary to note that the catalog utilized for generating the source model file in this study is the latest version, 4FGL-DR410. To more intu… view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: This map is the TS map of R1 in Figure [PITH_FULL_IMAGE:figures/full_fig_p010_4.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

20 extracted references · 18 canonical work pages

  1. [1]

    A., Ackermann, M., Ajello, M., et al., 2010, ApJS, 188, 405

    Abdo, A. A., Ackermann, M., Ajello, M., et al., 2010, ApJS, 188, 405

    work page 2010

  2. [2]

    Abdollahi, S., Acero, F., Ackermann, M., et al., 2020, ApJS, 247, 33 1 Acero,F., Ackermann,M., Ajello,M., et al., 2016,ApJS, 224,1 1, 7, 11

    work page 2020

  3. [3]

    et al., 2013, Sci, 339, 807 2, 6 14 Table 5: Analysis results of robustness verification Column Unit Description Namea

    Ackermann, M. et al., 2013, Sci, 339, 807 2, 6 14 Table 5: Analysis results of robustness verification Column Unit Description Namea ... New source name RA deg Right ascension DEC deg Declination Spatial Model ... Best-fit spatial model Spectral Model ... Best-fit spectral model Index ... Spectral index of powerlaw Index err ... Spectral index error of po...

    work page 2013

  4. [4]

    Ackermann, M., Ajello, M., Albert, A., et al., 2015, ApJL, 813,2 2 Anchordoqui,L., Paul,T., Reucroft,S., et al., 2003,International Journal of Modern Physics A, 18,13 13 Ballet,J., Bruel,P., Burnett,T.H., & Lott,B., 2024, arXiv:2307.12546 3 Barkov,M.V ., Aharonian,F.A., Bosch-Ramon,V ., 2010, ApJ, 724,2 2, 8

    arXiv 2015

  5. [5]

    R., 1978, MNRAS, 182, 147 3

    Bell, A. R., 1978, MNRAS, 182, 147 3

    work page 1978

  6. [6]

    A., Hofmann, W., Rieger, F

    Benkhali, F. A., Hofmann, W., Rieger, F. M., et al., 2020, A&A, 634: A120 2 Blasi,P., 2013,The Astronomy and Astrophysics Review, 21, 1-73 13 Cheung,C.C., Johnson,T.J., Jean,P., et al., 2022, ApJ, 935,1 3 de Boer,W., Bosse,L., Gebauer,I., et al., 2017, PhRvD, 96,4 2, 3 De Martino, D., Belloni, T., Falanga, M., et al., 2013, A&A, 550,A89 2 del Valle, M.V ....

    work page 2020

  7. [7]

    Dermer, C. D., Giebels, B.,2016, Comptes Rendus Physique, 17,6 2 Fryer,C.L., Woosley,S.E., Herant,M., et al., 1999, ApJ, 520,2 13 Grondin,M.H., Funk,S., Lemoine-Goumard, M., et al., 2011, ApJ, 738,1 3 Goldstein,A., Veres,P., Burns,E., et al., 2017, ApJL, 848,2 2 Gu´epin,C., Kotera,K., Barausse,E., et al., 2018, A&A, , 616, A179 2 Gunn,J.E., Ostriker,J.P.,...

    work page Pith review arXiv 2016

  8. [8]

    Lande, J., Ackermann, M., Allafort, A., et al., 2012, ApJ, 756, 5 2 15 Liu,B., Yang,R.,2022, A&A, 659, A101 6

    work page 2012

Show all 20 references
  1. [9]

    Madejski, G., Sikora, M., 2016, Annual Review of Astronomy and Astrophysics, 54, 725-760 2 Narayan,R., Paczy´nski,B., Piran,T., 1992, arXiv preprint astro-ph/9204001 Niino,Y ., Nagamine,K., Zhang,B., 2015,MNRAS, 449,3 13

    2016 arXiv

  2. [10]

    L., Abdo, A

    Nolan, P. L., Abdo, A. A., Ackermann, M., et al., 2012, ApJS, 199, 31 2

    2012

  3. [11]

    Peng, F.-K., Wang, X.-Y ., Liu, R.-Y ., et al., 2016, ApJL, 821, L20 3 Peron,G., Casanova,S., Baghmanyan,V . et al., 2022, 7th Heidelberg International Symposium on High- Energy Gamma-Ray Astronomy, 7,394 6, 7 Roberts,O.J., Fitzpatrick,G., Stanbro,M., et al., 2018, Journal of ...

    2016

  4. [12]

    E., et al., 2020, NatMe, 17, 261 2

    Virtanen, P., Gommers, R., Oliphant, T. E., et al., 2020, NatMe, 17, 261 2

    2020

  5. [13]

    Wood, M., Caputo, R., Charles, E., et al., 2017, ICRC (Busan), 301, 824 13 Woosley,S.E., Weaver,T.A., 1995, Lawrence Livermore National Lab.(LLNL), Livermore, CA (United States) 7

    2017

  6. [14]

    E., Heger, A., Weaver,T

    Woosley, S. E., Heger, A., Weaver,T. A., 2002, Reviews of modern physics, 74, 4 2, 3

    2002

  7. [15]

    E., & Bloom, J

    Woosley, S. E., & Bloom, J. S., 2006, ARA&A, 44, 507 2 Xiang,Y .C., & Jiang,Z.J., 2021, ApJ, 908, 22 2 Xiang,Y .C., Jiang,Z.J., & Tang,Y .Y ., 2021, ApJ, 911, 49 2

    2006

  8. [16]

    Xin, Y .-L., Zeng, H.-D., Liu, S.-M., Fan, Y .-Z., & Wei, D.-M., 2019, ApJ, 885, 162 8, 11

    2019

  9. [17]

    Xing, Y ., Wang, Z., Zhang, X., & Chen, Y ., 2016, ApJ, 823, 44 11

    2016

  10. [18]

    H., Xin, Y

    Yuan, Q., Liao, N. H., Xin, Y . L., et al., 2018, ApJL, 854, L18 11 Zhang,L., Chen,S.B., Fang,J., 2008, ApJ, 676,2 8

    2018

  11. [19]

    F., Xin, Y

    Zhang, P. F., Xin, Y . L., Fu, L., et al., 2016, MNRAS, 459, 99 8

    2016

  12. [20]

    Zhou, J., Wang, Z., Chen, L., et al., 2018, Nature communications, 9,1 2 11 13

    2018

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.