Pith. sign in

REVIEW 2 cited by

PySBD: Pragmatic Sentence Boundary Disambiguation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2010.09657 v1 pith:O4Q6LTHV submitted 2020-10-19 cs.CL cs.AI

Nipun Sadvilkar , Mark Neumann This is my paper · ORCID
classification cs.CLcs.AI
keywords boundarypythonsentencedisambiguationexemplarsgoldenpragmaticpysbd
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

In this paper, we present a rule-based sentence boundary disambiguation Python package that works out-of-the-box for 22 languages. We aim to provide a realistic segmenter which can provide logical sentences even when the format and domain of the input text is unknown. In our work, we adapt the Golden Rules Set (a language-specific set of sentence boundary exemplars) originally implemented as a ruby gem - pragmatic_segmenter - which we ported to Python with additional improvements and functionality. PySBD passes 97.92% of the Golden Rule Set exemplars for English, an improvement of 25% over the next best open-source Python tool.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. High-Fidelity Simultaneous Speech-To-Speech Translation

    cs.CL 2025-02 conditional novelty 6.0 of 10

    A decoder-only multistream model with perplexity-based alignment achieves state-of-the-art French-English simultaneous speech-to-speech translation with close-to-human naturalness and voice fidelity.

  2. Divide (Text) and Conquer (Sentiment): Improved Sentiment Classification by Constituent Conflict Resolution

    cs.LG 2025-05 conditional novelty 4.0 of 10

    Aggregating sentiment scores from text constituents with a small MLP improves accuracy over off-the-shelf classifiers on SST and Twitter, and sometimes on Amazon, at a fraction of fine-tuning cost.

Pith tools