Pith. sign in

REVIEW 4 cited by

Towards Galaxy Foundation Models with Hybrid Contrastive Learning

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2206.11927 v1 pith:XWO25G7J submitted 2022-06-23 cs.CV astro-ph.GA

classification cs.CVastro-ph.GA
keywords pretraininglabelscontrastiveaccuracygalaxygz-evohybridlearning
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

New astronomical tasks are often related to earlier tasks for which labels have already been collected. We adapt the contrastive framework BYOL to leverage those labels as a pretraining task while also enforcing augmentation invariance. For large-scale pretraining, we introduce GZ-Evo v0.1, a set of 96.5M volunteer responses for 552k galaxy images plus a further 1.34M comparable unlabelled galaxies. Most of the 206 GZ-Evo answers are unknown for any given galaxy, and so our pretraining task uses a Dirichlet loss that naturally handles unknown answers. GZ-Evo pretraining, with or without hybrid learning, improves on direct training even with plentiful downstream labels (+4% accuracy with 44k labels). Our hybrid pretraining/contrastive method further improves downstream accuracy vs. pretraining or contrastive learning, especially in the low-label transfer regime (+6% accuracy with 750 labels).

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 14 citations worldwide. Full citation record

  1. Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics

    astro-ph.IM 2026-04 unverdicted novelty 7.0 of 10

    Overlapping multi-instrument galaxy images plus dual encoders and flow-matching counterfactual generation yield physics latents unconfounded by sensor artifacts.

  2. Are vision language models robust to uncertain inputs?

    cs.CV 2025-05 conditional novelty 5.0 of 10

    Prompting VLMs to say "unknown" on ambiguous inputs substantially improves classification reliability on natural images, and caption diversity tracks this abstention behavior, though the mechanism fails on specialized...

  3. From Galaxy Zoo DECaLS to BASS/MzLS: detailed galaxy morphology classification with unsupervised domain adaption

    astro-ph.GA 2024-12 conditional novelty 5.0 of 10

    Unsupervised domain adaptation transfers a Galaxy Zoo DECaLS-trained morphology model to BASS/MzLS images, yielding improved classifications and a 248,088-galaxy catalogue.

  4. From stellar light to astrophysical insight: automating variable star research with machine learning

    astro-ph.IM 2025-07 unverdicted

    An invited review of machine learning for automated variable star research, covering data cleaning, variability classification, stellar parameter inference, and foundation models.

Pith tools