Pith. sign in

REVIEW 4 cited by

The Multimodal Universe: Enabling Large-Scale Machine Learning with 100TB of Astronomical Scientific Data

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.02527 v1 pith:M72Q2VSO submitted 2024-12-03 astro-ph.IM astro-ph.GAastro-ph.SR

The Multimodal Universe: Enabling Large-Scale Machine Learning with 100TB of Astronomical Scientific Data

classification astro-ph.IM astro-ph.GAastro-ph.SR
keywords multimodalscientificuniverseastronomicaldatalearningmachinedataset
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

We present the MULTIMODAL UNIVERSE, a large-scale multimodal dataset of scientific astronomical data, compiled specifically to facilitate machine learning research. Overall, the MULTIMODAL UNIVERSE contains hundreds of millions of astronomical observations, constituting 100\,TB of multi-channel and hyper-spectral images, spectra, multivariate time series, as well as a wide variety of associated scientific measurements and "metadata". In addition, we include a range of benchmark tasks representative of standard practices for machine learning methods in astrophysics. This massive dataset will enable the development of large multi-modal models specifically targeted towards scientific applications. All codes used to compile the MULTIMODAL UNIVERSE and a description of how to access the data is available at https://github.com/MultimodalUniverse/MultimodalUniverse

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics

    astro-ph.IM 2026-04 unverdicted novelty 7.0

    A dual-encoder deep learning method disentangles intrinsic astrophysical signals from measurement artifacts by treating sensor effects as augmentations and using counterfactual generation on overlapping observations.

  2. Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics

    astro-ph.IM 2026-04 conditional novelty 6.5

    Overlapping multi-instrument galaxy images plus dual encoders and flow-matching counterfactual generation yield physics latents unconfounded by sensor artifacts.

  3. MULTISEISMO: A Multimodal Seismic Dataset and Model for Cross-Modal Seismic Understanding

    cs.LG 2026-05 unverdicted novelty 6.0

    MultiSeismo is a new multimodal seismic dataset with 16K events and SeisModal is a domain-adapted model that outperforms general multimodal models on seismic reasoning tasks.

  4. A Gaia-linked High-purity QSO Candidate Catalog in Selected Fields with Extinction-binned Calibration and Spectrum-informed Training

    astro-ph.IM 2026-05 unverdicted novelty 4.0

    The P3 selector achieves 0.9809 purity and 0.8869 completeness for QSO candidates in selected fields, outperforming Gaia's official probabilities.