REVIEW 2 cited by
Finetuning Stellar Spectra Foundation Models with LoRA
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Finetuning Stellar Spectra Foundation Models with LoRA
read the original abstract
Foundation models are beginning to impact stellar spectroscopy, where spectra encode rich physical information in a structured, language-like form. A key challenge is adapting these models across heterogeneous surveys with differing resolution and coverage. We apply Low-Rank Adaptation (LoRA) to fine-tune SpecCLIP--a contrastively pre-trained model on LAMOST and Gaia XP spectra--for downstream tasks on DESI Early Data Release (EDR) spectra. We show that LoRA enables few-shot learning on DESI, with performance varying by fine-tuned module and benefiting from Gaia XP knowledge embedded in the pre-trained model. Our results demonstrate that LoRA provides a lightweight and effective strategy for extending spectral foundation models to new instruments and survey domains.
Forward citations
Cited by 2 Pith papers
-
Generalization from Low- to Moderate-Resolution Spectra with Neural Networks for Stellar Parameter Estimation: A Case Study with DESI
Pre-trained MLPs on LAMOST low-resolution spectra generalize to DESI medium-resolution spectra for [Fe/H] and [α/Fe], outperforming the DESI SP pipeline in zero-shot and improving with modest fine-tuning.
-
Foundation Models for Astrophysics
Astronomical 'foundation models' largely reuse transformers and self-supervised pretraining, but evidence of transfer to new instruments, populations, or tasks remains rare; the paper argues such evidence, not archite...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.