Pith. sign in

REVIEW 5 cited by

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2202.01279 v3 pith:XGWJEGHE submitted 2022-02-02 cs.LG cs.CL

classification cs.LGcs.CL
keywords promptspromptsourcelanguagenaturalavailabledevelopmentusersaddresses
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

PromptSource is a system for creating, sharing, and using natural language prompts. Prompts are functions that map an example from a dataset to a natural language input and target output. Using prompts to train and query language models is an emerging area in NLP that requires new tools that let users develop and refine these prompts collaboratively. PromptSource addresses the emergent challenges in this new setting with (1) a templating language for defining data-linked prompts, (2) an interface that lets users quickly iterate on prompt development by observing outputs of their prompts on many examples, and (3) a community-driven set of guidelines for contributing new prompts to a common pool. Over 2,000 prompts for roughly 170 datasets are already available in PromptSource. PromptSource is available at https://github.com/bigscience-workshop/promptsource.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Prompt Orchestration Markup Language

    cs.HC 2025-08 conditional novelty 6.0 of 10

    POML is a markup language that structures LLM prompts, embeds multimodal data, and decouples formatting via stylesheets, with case studies showing strong prompt format sensitivity.

  2. Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning

    cs.HC 2025-01 conditional novelty 6.0 of 10

    Gensors lets everyday users define personalized visual sensors by decomposing their sensing goal into testable criteria, and a user study shows improved perceived control and understanding over prompt-only authoring.

  3. Tensorized Clustered LoRA Merging for Multi-Task Interference

    cs.LG 2025-08 unverdicted novelty 5.0 of 10

    Clustering training data by embedding similarity and jointly CP-decomposing LoRA adapters cuts multi-task merging interference: +1.4% on Phi-3 and +2.3% on Mistral-7B over SVD baselines.

  4. LLM Augmentations to support Analytical Reasoning over Multiple Documents

    cs.CL 2024-11 conditional novelty 5.0 of 10

    LLMs alone and with dynamic evidence tree augmentation still fail to produce the implicit, speculative reasoning that intelligence analysis requires.

  5. GRL-Prompt: Towards Knowledge Graph based Prompt Optimization via Reinforcement Learning

    cs.CL 2024-11 conditional novelty 5.0 of 10

    A knowledge-graph-based reinforcement learning policy selects and orders in-context examples for LLM prompts, reporting modest ROUGE and BLEU improvements.

Pith tools