Pith. sign in

REVIEW 2 cited by

Enriching Datasets with Demographics through Large Language Models: What's in a Name?

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2409.11491 v1 pith:FTIMO5DT submitted 2024-09-17 cs.CL

classification cs.CL
keywords datasetsmodelsdemographicllmsbiasesdemographicsenrichinglack
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Enriching datasets with demographic information, such as gender, race, and age from names, is a critical task in fields like healthcare, public policy, and social sciences. Such demographic insights allow for more precise and effective engagement with target populations. Despite previous efforts employing hidden Markov models and recurrent neural networks to predict demographics from names, significant limitations persist: the lack of large-scale, well-curated, unbiased, publicly available datasets, and the lack of an approach robust across datasets. This scarcity has hindered the development of traditional supervised learning approaches. In this paper, we demonstrate that the zero-shot capabilities of Large Language Models (LLMs) can perform as well as, if not better than, bespoke models trained on specialized data. We apply these LLMs to a variety of datasets, including a real-life, unlabelled dataset of licensed financial professionals in Hong Kong, and critically assess the inherent demographic biases in these models. Our work not only advances the state-of-the-art in demographic enrichment but also opens avenues for future research in mitigating biases in LLMs.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Network Contagion in Financial Labor Markets: Predicting Turnover in Hong Kong

    cs.SI 2025-09 conditional novelty 5.0 of 10

    Network-derived features from the SFC register improve monthly turnover prediction in Hong Kong finance by about 30% in average precision over non-network baselines.

  2. Obscured but Not Erased: Evaluating Nationality Bias in LLMs via Name-Based Bias Benchmarks

    cs.CL 2025-07 conditional novelty 5.0 of 10

    A name-substituted variant of the BBQ benchmark shows that LLMs retain nationality stereotypes even when explicit labels are removed, with smaller models showing more bias and lower accuracy.

Pith tools