Pith. sign in

REVIEW 8 cited by

Large Language Models Reflect the Ideology of their Creators

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2410.18417 v2 pith:D5EKR2IM submitted 2024-10-24 cs.CL cs.LG

classification cs.CLcs.LG
keywords modelsllmslanguagelargepoliticalcreatorsdifferencesdifferent
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large language models (LLMs) are trained on vast amounts of data to generate natural language, enabling them to perform tasks like text summarization and question answering. These models have become popular in artificial intelligence (AI) assistants like ChatGPT and already play an influential role in how humans access information. However, the behavior of LLMs varies depending on their design, training, and use. In this paper, we prompt a diverse panel of popular LLMs to describe a large number of prominent personalities with political relevance, in all six official languages of the United Nations. By identifying and analyzing moral assessments reflected in their responses, we find normative differences between LLMs from different geopolitical regions, as well as between the responses of the same LLM when prompted in different languages. Among only models in the United States, we find that popularly hypothesized disparities in political views are reflected in significant normative differences related to progressive values. Among Chinese models, we characterize a division between internationally- and domestically-focused models. Our results show that the ideological stance of an LLM appears to reflect the worldview of its creators. This poses the risk of political instrumentalization and raises concerns around technological and regulatory efforts with the stated aim of making LLMs ideologically 'unbiased'.

Discussion (0). Sign in to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 13 citations worldwide. Full citation record

  1. Exposure is not manifestation: measurement target and output resolution jointly determine which behavioural-faithfulness evaluator wins

    cs.CL 2026-07 conditional novelty 6.0 of 10

    Small hyperbolic models (146M–3B) report 100% creative-seed preference, 90.7% compliance-gap detection, and a selective-gating skeleton–wallpaper memory pilot as a companion-AI stack.

  2. POW: Political Overton Windows of Large Language Models

    cs.CY 2025-09 conditional novelty 6.0 of 10

    Using extreme persona prompts and the Political Compass Test, the authors map each LLM's Overton Window and find most models will only express left-liberal views, refusing authoritarian-left and liberal-right positions.

  3. Adultification Bias in LLMs and Text-to-Image Models

    cs.CY 2025-06 conditional novelty 6.0 of 10

    Large language and text-to-image models show measurable adultification bias, portraying Black girls as more mature, culpable, and sexualized than White girls in several tested models.

  4. Are Economists Always More Introverted? Analyzing Consistency in Persona-Assigned LLMs

    cs.CL 2025-06 conditional novelty 6.0 of 10

    A multi-task evaluation framework shows persona consistency in LLMs varies by persona category, task structure, and model, with stereotyped spillovers and default personas shaping outputs.

  5. Analyzing Political Bias in LLMs via Target-Oriented Sentiment Classification

    cs.CL 2025-05 conditional novelty 6.0 of 10

    LLMs show systematic target-dependent sentiment inconsistency that is politically biased: left and center politicians rated more positively, far-right politicians more negatively, with stronger effects in larger model...

  6. Generative Exaggeration in LLM Social Agents: Consistency, Bias, and Toxicity

    cs.HC 2025-07 conditional novelty 5.0 of 10

    When LLMs are given more context about a real social media user, they become more ideologically consistent but also more extreme, toxic, and stereotyped than the user actually is.

  7. Information Suppression in Large Language Models: Auditing, Quantifying, and Characterizing Censorship in DeepSeek

    cs.CY 2025-06 conditional novelty 5.0 of 10

    DeepSeek-R1's final outputs omit sensitive topic keywords that appear in its internal chain-of-thought, indicating semantic-level information suppression.

  8. Public Service Algorithm: towards a transparent, explainable, and scalable content curation for news content based on editorial values

    cs.CY 2025-06 conditional novelty 4.0 of 10

    In a 30-article pilot with four editorial criteria, the best LLMs achieved up to 75% overlap with human editors' top-5 article selections.

Pith tools