Pith. sign in

REVIEW 3 cited by

Demographic Dialectal Variation in Social Media: A Case Study of African-American English

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1608.08868 v1 pith:SX5OUGLK submitted 2016-08-31 cs.CL

classification cs.CL
keywords languagetextaae-likedialectalafrican-americanassociatedcaseenglish
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Though dialectal language is increasingly abundant on social media, few resources exist for developing NLP tools to handle such language. We conduct a case study of dialectal language in online conversational text by investigating African-American English (AAE) on Twitter. We propose a distantly supervised model to identify AAE-like language from demographics associated with geo-located messages, and we verify that this language follows well-known AAE linguistic phenomena. In addition, we analyze the quality of existing language identification and dependency parsing tools on AAE-like text, demonstrating that they perform poorly on such text compared to text associated with white speakers. We also provide an ensemble classifier for language identification which eliminates this disparity and release a new corpus of tweets containing AAE-like language.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. My LLM might Mimic AAE -- But When Should it?

    cs.CL 2025-02 conditional novelty 6.0 of 10

    Black Americans favor letting users choose when LLMs speak African American English, and rated LLM-generated AAE as comparable to human transcripts, although some outputs were seen as mocking.

  2. When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governance

    cs.CL 2025-07 conditional novelty 4.0 of 10

    A literature review that classifies LLM-for-law research using a dual-lens taxonomy of Toulmin argumentation components and legal practitioner roles.

  3. Steps Adaptive Decay DPSGD: Enhancing Performance on Imbalanced Datasets with Differential Privacy with HAM10000

    cs.LG 2025-07 reject novelty 4.0 of 10

    SAD-DPSGD, a step-adaptive decay schedule for noise and clipping in DP-SGD, reports about 1% higher accuracy than Auto-DPSGD on HAM10000 under differential privacy.

Pith tools