Fine-tuning on a new multi-task U.S. political dataset makes Phi-2, Mistral, and Llama-3 express five nuanced ideological positions, with explicit prompts giving only marginal additional alignment.
Inducing Political Bias Allows Language Models Anticipate Partisan Reactions to Controversies
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Social media platforms are rife with politically charged discussions. Therefore, accurately deciphering and predicting partisan biases using Large Language Models (LLMs) is increasingly critical. In this study, we address the challenge of understanding political bias in digitized discourse using LLMs. While traditional approaches often rely on finetuning separate models for each political faction, our work innovates by employing a singular, instruction-tuned LLM to reflect a spectrum of political ideologies. We present a comprehensive analytical framework, consisting of Partisan Bias Divergence Assessment and Partisan Class Tendency Prediction, to evaluate the model's alignment with real-world political ideologies in terms of stances, emotions, and moral foundations. Our findings reveal the model's effectiveness in capturing emotional and moral nuances, albeit with some challenges in stance detection, highlighting the intricacies and potential for refinement in NLP tools for politically sensitive contexts. This research contributes significantly to the field by demonstrating the feasibility and importance of nuanced political understanding in LLMs, particularly for applications requiring acute awareness of political bias.
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Probing the Subtle Ideological Manipulation of Large Language Models
Fine-tuning on a new multi-task U.S. political dataset makes Phi-2, Mistral, and Llama-3 express five nuanced ideological positions, with explicit prompts giving only marginal additional alignment.