REVIEW 3 cited by
SKATR: A Self-Supervised Summary Transformer for SKA
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The Square Kilometer Array will initiate a new era of radio astronomy by allowing 3D imaging of the Universe during Cosmic Dawn and Reionization. Modern machine learning is crucial to analyse the highly structured and complex signal. However, accurate training data is expensive to simulate, and supervised learning may not generalize. We introduce a self-supervised vision transformer, SKATR, whose learned encoding can be cheaply adapted for downstream tasks on 21cm maps. Focusing on regression and generative inference of astrophysical and cosmological parameters, we demonstrate that SKATR representations are maximally informative and that SKATR generalises out-of-domain to differently-simulated, noised, and higher-resolution datasets.
Forward citations
Cited by 3 Pith papers
-
Neural Control Variates at LO and NLO
Signed neural control variates from normalizing flows, combined with neural importance sampling, reduce weight ranges and negative weights for LO and NLO phase-space integration and event generation.
-
Agentic Re-Casting using Agentic Re-Simulations
An agentic AI system with a physicist in the loop re-casts an ATLAS ttZ measurement into a global top-quark SMEFT fit and recovers injected coloron Wilson coefficients in a repeatable benchmark.
-
CosmoUiT: A Vision Transformer-UNet Hybrid for Fast and Accurate Emulation of 21-cm Maps from the Epoch of Reionization
A Vision Transformer-UNet hybrid emulates 3D EoR 21-cm cubes conditioned on reionization parameters, matching simulated large-scale power spectra with mild small-scale suppression.
Discussion (0). Continue with ORCID to comment.