A Simulation System Towards Solving Societal-Scale Manipulation
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:7S3VIQY2record.jsonopen to challenge →
read the original abstract
The rise of AI-driven manipulation poses significant risks to societal trust and democratic processes. Yet, studying these effects in real-world settings at scale is ethically and logistically impractical, highlighting a need for simulation tools that can model these dynamics in controlled settings to enable experimentation with possible defenses. We present a simulation environment designed to address this. We elaborate upon the Concordia framework that simulates offline, `real life' activity by adding online interactions to the simulation through social media with the integration of a Mastodon server. We improve simulation efficiency and information flow, and add a set of measurement tools, particularly longitudinal surveys. We demonstrate the simulator with a tailored example in which we track agents' political positions and show how partisan manipulation of agents can affect election results.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
SidConArena: An Environment Evaluating Agents in Open-Ended,Positive-Sum Bargaining Game
SidConArena is a new multi-phase benchmark framework formalizing a partially observable stochastic game for evaluating LLM agents in open-ended positive-sum bargaining with negotiation, converter production, and seale...
-
Opinion Polarization in LLM-Based Social Networks: Manipulation and Mitigation
LLM-agent simulations show limited-budget adversaries can amplify polarization in social networks and that reactive and proactive mitigations do not fully restore baseline polarization.
-
Synthia: Scalable Grounded Persona Generation from Social Media Data
Synthia creates scalable personas from Bluesky posts that better match human survey responses than prior methods, uses smaller models, and retains social network structure for network-aware analysis.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.