Pith. sign in

REVIEW 2 cited by

I Am Not Them: Fluid Identities and Persistent Out-group Bias in Large Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.10436 v1 pith:P5YUJ4XB submitted 2024-02-16 cs.CL

classification cs.CL
keywords out-groupvaluesin-groupchatgptlanguagesbiaslanguagemodels
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We explored cultural biases-individualism vs. collectivism-in ChatGPT across three Western languages (i.e., English, German, and French) and three Eastern languages (i.e., Chinese, Japanese, and Korean). When ChatGPT adopted an individualistic persona in Western languages, its collectivism scores (i.e., out-group values) exhibited a more negative trend, surpassing their positive orientation towards individualism (i.e., in-group values). Conversely, when a collectivistic persona was assigned to ChatGPT in Eastern languages, a similar pattern emerged with more negative responses toward individualism (i.e., out-group values) as compared to collectivism (i.e., in-group values). The results indicate that when imbued with a particular social identity, ChatGPT discerns in-group and out-group, embracing in-group values while eschewing out-group values. Notably, the negativity towards the out-group, from which prejudices and discrimination arise, exceeded the positivity towards the in-group. The experiment was replicated in the political domain, and the results remained consistent. Furthermore, this replication unveiled an intrinsic Democratic bias in Large Language Models (LLMs), aligning with earlier findings and providing integral insights into mitigating such bias through prompt engineering. Extensive robustness checks were performed using varying hyperparameter and persona setup methods, with or without social identity labels, across other popular language models.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Leveraging In-Context Learning for Political Bias Testing of LLMs

    cs.CL 2025-06 conditional novelty 6.0 of 10

    Questionnaire Modeling uses human survey responses as in-context examples to measure LLM political bias relative to a human population, improving paraphrase stability and exposing instruction-tuning-induced bias flips.

  2. A Multifaceted Analysis of Social Biases in Large Language Models

    cs.CY 2025-12 conditional novelty 4.0 of 10

    Four widely used LLMs exhibit distinct, measurable political, ideological, alliance, language, and gender biases across five probing tasks.

Pith tools