Pith. sign in

REVIEW 2 cited by

Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2111.01243 v1 pith:LNRQJKWO submitted 2021-11-01 cs.CL cs.AIcs.LG

classification cs.CLcs.AIcs.LG
keywords languagemodelslargepre-trainedapproachesnaturalprocessingrecent
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Large, pre-trained transformer-based language models such as BERT have drastically changed the Natural Language Processing (NLP) field. We present a survey of recent work that uses these large language models to solve NLP tasks via pre-training then fine-tuning, prompting, or text generation approaches. We also present approaches that use pre-trained language models to generate data for training augmentation or other purposes. We conclude with discussions on limitations and suggested directions for future research.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Bringing legal knowledge to the public by constructing a legal question bank using large-scale pre-trained language model

    cs.CL 2025-05 conditional novelty 4.0 of 10

    A hybrid GPT-3 prompting strategy generates legal questions at scale, achieving 68% precision and 93% paragraph coverage, while human experts remain more precise.

  2. RefSAM3D: Adapting SAM with Cross-modal Reference for 3D Medical Image Segmentation

    cs.CV 2024-12 reject novelty 4.0 of 10

    RefSAM3D combines 3D adapters, text prompts, and hierarchical cross-attention to adapt SAM for 3D medical segmentation, claiming state-of-the-art Dice scores and CT-to-MRI zero-shot transfer.

Pith tools