Pith. sign in

REVIEW 2 cited by

Improving astroBERT using Semantic Textual Similarity

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2212.00744 v1 pith:SFHYIVW5 submitted 2022-11-29 cs.CL astro-ph.IM

Felix Grezes , Thomas Allen , Sergi Blanco-Cuaresma , Alberto Accomazzi , Michael J. Kurtz , Golnaz Shapurian , Edwin Henneken , Carolyn S. Grant
show 8 more authors
Donna M. Thompson Timothy W. Hostetler Matthew R. Templeton Kelly E. Lockhart Shinyi Chen Jennifer Koch Taylor Jacovich Pavlos Protopapas
This is my paper · ORCID
classification cs.CLastro-ph.IM
keywords astrobertlanguageastrophysicsastronomycitationmodelpublicscientific
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The NASA Astrophysics Data System (ADS) is an essential tool for researchers that allows them to explore the astronomy and astrophysics scientific literature, but it has yet to exploit recent advances in natural language processing. At ADASS 2021, we introduced astroBERT, a machine learning language model tailored to the text used in astronomy papers in ADS. In this work we: - announce the first public release of the astroBERT language model; - show how astroBERT improves over existing public language models on astrophysics specific tasks; - and detail how ADS plans to harness the unique structure of scientific papers, the citation graph and citation context, to further improve astroBERT.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Astro-HEP-BERT: A bidirectional language model for studying the meanings of concepts in astrophysics and high energy physics

    cs.CL 2024-11 conditional novelty 5.0 of 10

    This paper introduces Astro-HEP-BERT, a BERT model adapted to astrophysics and high-energy physics text, plus a large arXiv-based corpus, as a low-cost tool for studying conceptual change in science.

  2. Meaning at the Planck scale? Contextualized word embeddings for doing history, philosophy, and sociology of science

    cs.CL 2024-11 conditional novelty 5.0 of 10

    Domain-adapted BERT models distinguish senses of 'Planck' better than general models, and reveal the rise of the Planck mission meaning in physics papers.

Pith tools