Pith. sign in

REVIEW 1 cited by

Introducing a multiscale feature integration network for inpainting with applications to enhanced CMB map reconstruction

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2501.06139 v3 pith:KIH6KIKB submitted 2025-01-10 astro-ph.CO

classification astro-ph.CO
keywords networkinpaintingmasksmissingchallengescombinesconvolutionscosmic
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We introduce a novel neural network, SkyReconNet, which combines the expanded receptive fields of dilated convolutional layers along with standard convolutions, to capture both the global and local features for reconstructing the missing information in an image. We implement our network to inpaint the masked regions in a full-sky Cosmic Microwave Background (CMB) map. Inpainting CMB maps is a particularly formidable challenge when dealing with extensive and irregular masks, such as galactic masks which can obscure substantial fractions of the sky. The hybrid design of SkyReconNet leverages the strengths of standard and dilated convolutions to accurately predict CMB fluctuations in the masked regions, by effectively utilizing the information from surrounding unmasked areas. During training, the network optimizes its weights by minimizing a composite loss function that combines the Structural Similarity Index Measure (SSIM) and mean squared error (MSE). SSIM preserves the essential structural features of the CMB, ensuring an accurate and coherent reconstruction of the missing CMB fluctuations, while MSE minimizes the pixel-wise deviations, enhancing the overall accuracy of the predictions. The predicted CMB maps and their corresponding angular power spectra align closely with the targets, achieving the performance limited only by the fundamental uncertainty of cosmic variance. The network's generic architecture enables application to other physics-based challenges involving data with missing or defective pixels, systematic artefacts etc. Our results demonstrate its effectiveness in addressing the challenges posed by large irregular masks, offering a significant inpainting tool not only for CMB analyses but also for image-based experiments across disciplines where such data imperfections are prevalent.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Deep Needlet: A CNN based full sky component separation method in Needlet space

    astro-ph.CO 2025-01 conditional novelty 5.0 of 10

    A CNN trained on needlet-filtered Planck-like simulations recovers CMB temperature maps with lower foreground residuals than NILC and power spectra accurate to ell about 1100.

Reference graph

Works this paper leans on

85 extracted references · 64 canonical work pages · cited by 1 Pith paper

  1. [1]

    C. L. Bennett et al.(WMAP), Astrophys. J. Suppl. 148, 1 (2003), arXiv:astro-ph/0302207

  2. [2]

    P. A. R. Ade et al., Astronomy & Astrophysics 536, A1 (2011), arXiv:1101.2022 [astro-ph.IM]

  3. [3]

    Durrer, Class

    R. Durrer, Class. Quant. Grav. 32, 124007 (2015), arXiv:1506.01907 [astro-ph.CO]

  4. [4]

    K. N. Abazajian et al., Astropart. Phys. 63, 55 (2015), arXiv:1309.5381 [astro-ph.CO]

  5. [5]

    P. A. R. Ade et al. (Planck), Astron. Astrophys. 571, A22 (2014), arXiv:1303.5082 [astro-ph.CO]

  6. [6]

    Aghanim, Y

    N. Aghanim, Y. Akrami, M. Ashdown, J. Aumont, C. Baccigalupi, M. Ballardini, A. J. Banday, R. Barreiro, N. Bartolo, S. Basak, et al., Astronomy & Astrophysics 641, A6 (2020)

  7. [7]

    S. Masi, P. De Bernardis, G. De Troia, M. Giacometti, A. Iacoangeli, F. Piacentini, G. Polenta, P. A. Ade, P. D. Mauskopf, J. Bock, et al., Progress in Particle and Nu- clear Physics 48, 243 (2002)

  8. [8]

    C. L. Bennett, M. Bay, M. Halpern, G. Hinshaw, C. Jack- son, N. Jarosik, A. Kogut, M. Limon, S. Meyer, L. Page, et al., The Astrophysical Journal 583, 1 (2003)

Show all 85 references
  1. [9]

    Hincks, V

    A. Hincks, V. Acquaviva, P. A. Ade, P. Aguirre, M. Amiri, J. Appel, L. Barrientos, E. S. Battistelli, J. Bond, B. Brown, et al., The Astrophysical Journal Supplement Series 191, 423 (2010)

  2. [10]

    N. N. Gandilo, P. A. Ade, D. Benford, C. L. Bennett, D. T. Chuss, J. L. Dotson, J. R. Eimer, D. J. Fixsen, M. Halpern, G. Hilton, et al., in Millimeter, Submillime- ter, and Far-Infrared Detectors and Instrumentation for Astronomy VIII, Vol. 9914 (SPIE, 2016) pp. 372–379

  3. [11]

    Gualtieri, J

    R. Gualtieri, J. Filippini, P. Ade, M. Amiri, S. Benton, A. Bergman, R. Bihary, J. Bock, J. Bond, S. Bryan,et al., 12 Journal of Low Temperature Physics 193, 1112 (2018)

  4. [12]

    Li, S.-Y

    H. Li, S.-Y. Li, Y. Liu, Y.-P. Li, Y. Cai, M. Li, G.-B. Zhao, C.-Z. Liu, Z.-W. Li, H. Xu, et al., National Science Review 6, 145 (2019)

  5. [13]

    H. Hui, P. Ade, Z. Ahmed, R. Aikin, K. D. Alexander, D. Barkats, S. J. Benton, C. A. Bischoff, J. J. Bock, R. Bowens-Rubin, et al., in Millimeter, Submillimeter, and Far-Infrared Detectors and Instrumentation for As- tronomy IX, Vol. 10708 (SPIE, 2018) pp. 75–89

  6. [14]

    Abazajian, A

    K. Abazajian, A. Abdulghafour, G. E. Addison, P. Ad- shead, Z. Ahmed, M. Ajello, D. Akerib, S. W. Allen, D. Alonso, M. Alvarez, et al., arXiv preprint arXiv:2203.08024 (2022)

  7. [15]

    D. Adak, A. Sen, S. Basak, J. Delabrouille, T. Ghosh, A. Rotti, G. Mart ´ ınez-Solaeche, and T. Souradeep, Monthly Notices of the Royal Astronomical Society 514, 3002 (2022)

  8. [16]

    Collaboration, E

    L. Collaboration, E. Allys, K. Arnold, J. Aumont, R. Au- rlien, S. Azzoni, C. Baccigalupi, A. Banday, R. Banerji, R. Barreiro, et al., Progress of Theoretical and Experi- mental Physics 2023, 042F01 (2023)

  9. [17]

    Eriksen, C

    H. Eriksen, C. Dickinson, J. Jewell, A. Banday, K. G´ orski, and C. Lawrence, The Astrophysical Jour- nal 672, L87 (2007)

  10. [18]

    Eriksen, J

    H. Eriksen, J. Jewell, C. Dickinson, A. Banday, K. G´ orski, and C. Lawrence, The Astrophysical Jour- nal 676, 10 (2008)

  11. [19]

    Land and J

    K. Land and J. Magueijo, Monthly Notices of the Royal Astronomical Society 367, 1714 (2006)

  12. [20]

    Jaffe, A

    T. Jaffe, A. Banday, H. Eriksen, K. G´ orski, and F. Hansen, The Astrophysical Journal 643, 616 (2006)

  13. [21]

    Bennett, R

    C. Bennett, R. S. Hill, G. Hinshaw, M. Nolta, N. Ode- gard, L. Page, D. Spergel, J. Weiland, E. Wright, M. Halpern, et al., The Astrophysical Journal Supple- ment Series 148, 97 (2003)

  14. [22]

    H. K. Eriksen, A. Banday, K. G´ orski, and P. Lilje, The Astrophysical Journal 612, 633 (2004)

  15. [23]

    Tegmark, A

    M. Tegmark, A. de Oliveira-Costa, and A. J. Hamilton, Physical Review D 68, 123523 (2003)

  16. [24]

    Delabrouille, J.-F

    J. Delabrouille, J.-F. Cardoso, M. Le Jeune, M. Betoule, G. Fay, and F. Guilloux, Astronomy & Astrophysics493, 835 (2009)

  17. [25]

    Sudevan, P

    V. Sudevan, P. K. Aluri, S. K. Yadav, R. Saha, and T. Souradeep, The Astrophysical Journal 842, 62 (2017)

  18. [26]

    Sudevan and R

    V. Sudevan and R. Saha, Astrophys. J. 897, 30 (2020), arXiv:1810.08872 [astro-ph.CO]

  19. [27]

    Sudevan and R

    V. Sudevan and R. Saha, Astrophys. J. 867, 74 (2018), arXiv:1712.09804 [astro-ph.CO]

  20. [28]

    J. F. Taylor, M. A. J. Ashdown, and M. P. Hobson, in 41st Rencontres de Moriond: Workshop on Cosmol- ogy: Contents and Structures of the Universe(The Gioi, Hanoi, 2006) pp. 290–292

  21. [29]

    Hurier, J

    G. Hurier, J. Mac ´ ıas-P´ erez, and S. Hildebrandt, Astron- omy & Astrophysics 558, A118 (2013)

  22. [30]

    Hivon, K

    E. Hivon, K. M. G´ orski, C. B. Netterfield, B. P. Crill, S. Prunet, and F. Hansen, The Astrophysical Journal 567, 2 (2002)

  23. [31]

    Alonso, J

    D. Alonso, J. Sanchez, A. Slosar, and L. D. E. S. Col- laboration, Monthly Notices of the Royal Astronomical Society 484, 4127 (2019)

  24. [32]

    Tegmark, Phys

    M. Tegmark, Phys. Rev. D 55, 5895 (1997), arXiv:astro- ph/9611174

  25. [33]

    Tegmark and A

    M. Tegmark and A. de Oliveira-Costa, Phys. Rev. D 64, 063001 (2001), arXiv:astro-ph/0012120

  26. [34]

    J. D. Bilbao-Ahedo, R. B. Barreiro, P. Vielva, E. Mart ´ ınez-Gonz´ alez, and D. Herranz, JCAP07, 034 (2021), arXiv:2104.08528 [astro-ph.CO]

  27. [35]

    Abrial, Y

    P. Abrial, Y. Moudden, J.-L. Starck, J. Fadili, J. De- labrouille, and M. Nguyen, Statistical Methodology 5, 289 (2008), astrostatistics

  28. [36]

    Perotto, J

    L. Perotto, J. Bobin, S. Plaszczynski, J. L. Starck, and A. Lavabre, Astronomy & Astrophysics 519, A4 (2010)

  29. [37]

    Plaszczynski, A

    S. Plaszczynski, A. Lavabre, L. Perotto, and J. L. Starck, Astronomy & Astrophysics 544, A27 (2012), arXiv:1201.5779 [astro-ph.CO]

  30. [38]

    F. X. Dup´ e, A. Rassat, J. L. Starck, and M. J. Fadili, Astronomy & Astrophysics 534, A51 (2011), arXiv:1010.2192 [astro-ph.CO]

  31. [39]

    Hoffman and E

    Y. Hoffman and E. Ribak, Astrophysical Journal, Part 2-Letters (ISSN 0004-637X), vol. 380, Oct. 10, 1991, p. L5-L8. 380, L5 (1991)

  32. [40]

    Bucher and T

    M. Bucher and T. Louis, Monthly Notices of the Royal Astronomical Society 424, 1694 (2012)

  33. [41]

    J. Kim, P. Naselsky, and N. Mandolesi, The Astro- physical Journal Letters 750, L9 (2012), arXiv:1202.0188 [astro-ph.CO]

  34. [42]

    S. M. Feeney, H. V. Peiris, and A. Pontzen, Physi- cal Review D 84, 103002 (2011), arXiv:1107.5466 [astro- ph.CO]

  35. [43]

    C. J. Copi, D. Huterer, D. J. Schwarz, and G. D. Stark- man, Monthly Notices of the Royal Astronomical Society 418, 505 (2011)

  36. [44]

    P. A. R. Ade et al. (Planck), Astron. Astrophys. 571, A24 (2014), arXiv:1303.5084 [astro-ph.CO]

  37. [45]

    Gimeno-Amo, E

    C. Gimeno-Amo, E. Mart ´ ınez-Gonz´ alez, and R. B. Bar- reiro, JCAP 09, 038 (2024), arXiv:2405.06820 [astro- ph.CO]

  38. [46]

    Marcos-Caballero and E

    A. Marcos-Caballero and E. Mart ´ ınez-Gonz´ alez, JCAP 10, 053 (2019), arXiv:1909.06093 [astro-ph.CO]

  39. [47]

    Hochreiter, Neural Computation MIT-Press (1997)

    S. Hochreiter, Neural Computation MIT-Press (1997)

  40. [48]

    Goodfellow, J

    I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Ben- gio, Advances in neural information processing systems 27 (2014)

  41. [49]

    Vaswani, Advances in Neural Information Processing Systems (2017)

    A. Vaswani, Advances in Neural Information Processing Systems (2017)

  42. [50]

    Krizhevsky, I

    A. Krizhevsky, I. Sutskever, and G. E. Hinton, Commu- nications of the ACM 60, 84 (2017)

  43. [51]

    Z. Dai, H. Liu, Q. V. Le, and M. Tan, Advances in neural information processing systems 34, 3965 (2021)

  44. [52]

    Y. Cai, Y. Zhou, Q. Han, J. Sun, X. Kong, J. Li, and X. Zhang, arXiv preprint arXiv:2212.11696 (2022)

  45. [53]

    X. Zhou, V. Koltun, and P. Kr¨ ahenb¨ uhl, arXiv preprint arXiv:2103.07461 (2021)

  46. [54]

    M. Maaz, A. Shaker, H. Cholakkal, S. Khan, S. W. Za- mir, R. M. Anwer, and F. Shahbaz Khan, in European conference on computer vision(Springer, 2022) pp. 3–20

  47. [55]

    J. Dai, H. Qi, Y. Xiong, Y. Li, G. Zhang, H. Hu, and Y. Wei, in Proceedings of the IEEE international confer- ence on computer vision(2017) pp. 764–773

  48. [56]

    J. Xie, L. Xu, and E. Chen, in Advances in Neural Infor- mation Processing Systems, Vol. 25, edited by F. Pereira, C. Burges, L. Bottou, and K. Weinberger (Curran As- sociates, Inc., 2012)

  49. [57]

    Sohl-Dickstein, E

    J. Sohl-Dickstein, E. Weiss, N. Maheswaranathan, and S. Ganguli, in Proceedings of the 32nd International Con- ference on Machine Learning, Proceedings of Machine Learning Research, Vol. 37, edited by F. Bach and D. Blei 13 (PMLR, Lille, France, 2015) pp. 2256–2265

  50. [58]

    J. S. Ren, L. Xu, Q. Yan, and W. Sun, in Advances in Neural Information Processing Systems, Vol. 28, edited by C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett (Curran Associates, Inc., 2015)

  51. [59]

    N. Cai, Z. Su, Z. Lin, H. Wang, Z. Yang, and B. Ling, The Visual Computer 33 (2017), 10.1007/s00371-015- 1190-z

  52. [60]

    Pathak, P

    D. Pathak, P. Krahenbuhl, J. Donahue, T. Darrell, and A. A. Efros, arXiv e-prints , arXiv:1604.07379 (2016), arXiv:1604.07379 [cs.CV]

  53. [61]

    M. A. Petroff, G. E. Addison, C. L. Bennett, and J. L. Weiland, The Astrophysical Journal 903, 104 (2020)

  54. [62]

    Wang, H.-L

    G.-J. Wang, H.-L. Shi, Y.-P. Yan, J.-Q. Xia, Y.-Y. Zhao, S.-Y. Li, and J.-F. Li, The Astrophysical Journal Sup- plement Series 260, 13 (2022)

  55. [63]

    Casas, L

    J. Casas, L. Bonavera, J. Gonz´ alez-Nuevo, C. Bac- cigalupi, M. Cueli, D. Crespo, E. Goitia, J. Santos, M. S´ anchez, and F. de Cos, Astronomy & Astrophysics 666, A89 (2022)

  56. [64]

    Yan, G.-J

    Y.-P. Yan, G.-J. Wang, S.-Y. Li, and J.-Q. Xia, The Astrophysical Journal 947, 29 (2023)

  57. [65]

    Yan, S.-Y

    Y.-P. Yan, S.-Y. Li, G.-J. Wang, Z. Zhang, and J.-Q. Xia, The Astrophysical Journal Supplement Series 274, 4 (2024)

  58. [66]

    Sudevan and P

    V. Sudevan and P. Chen, (2024), arXiv:2406.19367 [astro-ph.CO]

  59. [67]

    Yan, G.-J

    Y.-P. Yan, G.-J. Wang, S.-Y. Li, and J.-Q. Xia, The Astrophysical Journal Supplement Series 267, 2 (2023)

  60. [68]

    Puglisi and X

    G. Puglisi and X. Bai, The Astrophysical Journal 905, 143 (2020)

  61. [69]

    K. Yi, Y. Guo, Y. Fan, J. Hamann, and Y. G. Wang, in 2020 International Joint Conference on Neural Networks (IJCNN) (IEEE, 2020) pp. 1–7

  62. [70]

    A. V. Sadr and F. Farsian, JCAP 03, 012 (2021), arXiv:2004.04177 [astro-ph.CO]

  63. [71]

    Montefalcone, M

    G. Montefalcone, M. H. Abitbol, D. Kodwani, and R. Grumitt, Journal of Cosmology and Astroparticle Physics 2021, 055 (2021)

  64. [72]

    Fluri, T

    J. Fluri, T. Kacprzak, A. Refregier, A. Amara, A. Lucchi, and T. Hofmann, Physical Review D 98, 123518 (2018)

  65. [73]

    Fluri, T

    J. Fluri, T. Kacprzak, A. Lucchi, A. Refregier, A. Amara, T. Hofmann, and A. Schneider, Physical Review D 100, 063514 (2019)

  66. [74]

    Farsian, N

    F. Farsian, N. Krachmalnicoff, and C. Baccigalupi, Jour- nal of Cosmology and Astroparticle Physics 2020, 017 (2020)

  67. [75]

    Caldeira, W

    J. Caldeira, W. K. Wu, B. Nord, C. Avestruz, S. Trivedi, and K. T. Story, Astronomy and Computing 28, 100307 (2019)

  68. [76]

    S. Pal, P. Chanda, and R. Saha, Astrophys. J. 945, 77 (2023), arXiv:2203.14060 [astro-ph.CO]

  69. [77]

    Akrami et al

    Y. Akrami et al. (Planck), Astron. Astrophys. 641, A4 (2020), arXiv:1807.06208 [astro-ph.CO]

  70. [78]

    Yu and V

    F. Yu and V. Koltun, arXiv preprint arXiv:1511.07122 (2015)

  71. [79]

    Hermann, T

    K. Hermann, T. Chen, and S. Kornblith, Advances in Neural Information Processing Systems 33, 19000 (2020)

  72. [80]

    Zhang, X

    Z. Zhang, X. Wang, and C. Jung, IEEE Transactions on Image Processing 28, 1625 (2019)

  73. [81]

    Ronneberger, P

    O. Ronneberger, P. Fischer, and T. Brox, in Medi- cal image computing and computer-assisted intervention– MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part III 18 (Springer, 2015) pp. 234–241

  74. [82]

    K. M. Gorski, E. Hivon, A. J. Banday, B. D. Wandelt, F. K. Hansen, M. Reinecke, and M. Bartelmann, The Astrophysical Journal 622, 759–771 (2005)

  75. [83]

    Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, IEEE Transactions on Image Processing 13, 600 (2004)

  76. [84]

    Lewis, A

    A. Lewis, A. Challinor, and A. Lasenby, The Astrophys- ical Journal 538, 473 (2000)

  77. [85]

    Kingma, arXiv preprint arXiv:1412.6980 (2014)

    D. Kingma, arXiv preprint arXiv:1412.6980 (2014)

Pith tools