Pith. sign in

REVIEW 2 cited by

LLMs generate structurally realistic social networks but overestimate political homophily

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2408.16629 v2 pith:EL7AZP25 submitted 2024-08-29 cs.CY cs.AIcs.SI

classification cs.CYcs.AIcs.SI
keywords networkssocialllmsnetworkgeneratedhomophilyfindmethods
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Generating social networks is essential for many applications, such as epidemic modeling and social simulations. The emergence of generative AI, especially large language models (LLMs), offers new possibilities for social network generation: LLMs can generate networks without additional training or need to define network parameters, and users can flexibly define individuals in the network using natural language. However, this potential raises two critical questions: 1) are the social networks generated by LLMs realistic, and 2) what are risks of bias, given the importance of demographics in forming social ties? To answer these questions, we develop three prompting methods for network generation and compare the generated networks to a suite of real social networks. We find that more realistic networks are generated with "local" methods, where the LLM constructs relations for one persona at a time, compared to "global" methods that construct the entire network at once. We also find that the generated networks match real networks on many characteristics, including density, clustering, connectivity, and degree distribution. However, we find that LLMs emphasize political homophily over all other types of homophily and significantly overestimate political homophily compared to real social networks.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Synthetic generation of online social networks through homophily

    cs.SI 2025-09 conditional novelty 6.0 of 10

    A homophily-based generator with triadic closure and long-range links reproduces five structural metrics from a 4M-user Bluesky graph at scales from 10^3 to 10^6 nodes.

  2. Leveraging Interview-Informed LLMs to Model Survey Responses: Comparative Insights from AI-Generated and Human Data

    cs.CL 2025-05 conditional novelty 5.0 of 10

    Interview-informed LLMs roughly reproduced average BREQ item responses but underestimated human variability and failed to recover the test's psychometric structure.

Pith tools