Pith. sign in

REVIEW 3 cited by

Towards better substitution-based word sense induction

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1905.12598 v2 pith:D3KYU2TH submitted 2019-05-29 cs.CL

Asaf Amrami , Yoav Goldberg This is my paper · ORCID
classification cs.CL
keywords methodwordclusteringclustersinductionsensesubstitutestask
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Word sense induction (WSI) is the task of unsupervised clustering of word usages within a sentence to distinguish senses. Recent work obtain strong results by clustering lexical substitutes derived from pre-trained RNN language models (ELMo). Adapting the method to BERT improves the scores even further. We extend the previous method to support a dynamic rather than a fixed number of clusters as supported by other prominent methods, and propose a method for interpreting the resulting clusters by associating them with their most informative substitutes. We then perform extensive error analysis revealing the remaining sources of errors in the WSI task. Our code is available at https://github.com/asafamr/bertwsi.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. "Dialogue" vs "Dialog" in NLP and AI research: Statistics from a Confused Discourse

    cs.CL 2024-12 conditional novelty 6.0 of 10

    Analysis of tens of thousands of papers shows NLP/AI research mixes 'dialogue' and 'dialog' with no clear trend, author, or context explanation.

  2. Large Language Models for History, Philosophy, and Sociology of Science: Interpretive Uses, Methodological Challenges, and Critical Perspectives

    cs.CL 2025-06 conditional novelty 3.0 of 10

    A position paper arguing that LLMs can enhance interpretive research in history, philosophy, and sociology of science, but only with model literacy, domain-specific benchmarks, and critical reflection.

  3. Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research

    cs.CL 2024-11 unverdicted novelty 2.0 of 10

    This survey paper identifies opportunities for LLMs in low-resource language humanities research along with challenges in data accessibility, model adaptability, and cultural sensitivity.

Pith tools