REVIEW 8 cited by
The Woman Worked as a Babysitter: On Biases in Language Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present a systematic study of biases in natural language generation (NLG) by analyzing text generated from prompts that contain mentions of different demographic groups. In this work, we introduce the notion of the regard towards a demographic, use the varying levels of regard towards different demographics as a defining metric for bias in NLG, and analyze the extent to which sentiment scores are a relevant proxy metric for regard. To this end, we collect strategically-generated text from language models and manually annotate the text with both sentiment and regard scores. Additionally, we build an automatic regard classifier through transfer learning, so that we can analyze biases in unseen text. Together, these methods reveal the extent of the biased nature of language model generations. Our analysis provides a study of biases in NLG, bias metrics and correlated human judgments, and empirical evidence on the usefulness of our annotated dataset.
Forward citations
Cited by 8 Pith papers
-
Scaling Truth: The Confidence Paradox in AI Fact-Checking
Across LLM fact-checking, model scale correlates with an inverse pattern of accuracy and decisiveness: smaller models are overconfident and less accurate, larger models are accurate but overly cautious.
-
Dutch CrowS-Pairs: Adapting a Challenge Dataset for Measuring Social Biases in Language Models for Dutch
The paper presents a Dutch adaptation of the CrowS-Pairs bias benchmark and reports bias scores for seven masked and two autoregressive language models across nine demographic categories.
-
Exploring Gender Bias Beyond Occupational Titles
The paper presents GenderLexicon and a ClozeGender score, reporting that action verbs and object nouns carry gender bias beyond occupational stereotypes in English and Japanese language models.
-
Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)
Placing demographic audience information in system prompts rather than user prompts shifts sentiment and ranking outputs across six commercial LLMs, but the design confounds position with instruction content.
-
Identifying Implicit Bias in LLM-based Chat AI Toward People with Intellectual Disabilities
Across 25,000 stories from five LLMs, an LLM judge rated stories mentioning intellectual disabilities as more infantile, paternalistic, dependent, and inspirational than stories without the label.
-
Inference Time Debiasing Concepts in Diffusion Models
DeCoDi subtracts a biased-concept guidance term during diffusion inference to shift generated images away from targeted stereotypes, with evaluation on gender, ethnicity, and age.
-
Investigating Intersectional Bias in Large Language Models using Confidence Disparities in Coreference Resolution
The abstract claims LLMs show up to 40% coreference confidence disparities across intersectional identities, but the article body is an unrelated paper on robotic fruit handling.
-
LoRA for Gender-Inclusive Rewriting and Activation Steering for Counter-Narrative Generation
On the LT-EDI 2026 shared task, LoRA fine-tuning scored 80.00% for gender-inclusive rewriting, while PCA-based activation steering of Gemma-3-4B-it scored 78.12% for counter-narrative generation, with a manual analysi...
Discussion (0). Sign in to comment.