PERSONACONVBENCH is a new Reddit-based benchmark showing that LLMs predict sentiment, community scores, and next replies better when given a user's multi-turn conversation history, and it releases public data and code.
REALM: A Dataset of Real-World LLM Use Cases
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Large Language Models (LLMs), such as the GPT series, have driven significant industrial applications, leading to economic and societal transformations. However, a comprehensive understanding of their real-world applications remains limited. To address this, we introduce REALM, a dataset of over 94,000 LLM use cases collected from Reddit and news articles. REALM captures two key dimensions: the diverse applications of LLMs and the demographics of their users. It categorizes LLM applications and explores how users' occupations relate to the types of applications they use. By integrating real-world data, REALM offers insights into LLM adoption across different domains, providing a foundation for future research on their evolving societal roles.
citation-role summary
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
A Personalized Conversational Benchmark: Towards Simulating Personalized Conversations
PERSONACONVBENCH is a new Reddit-based benchmark showing that LLMs predict sentiment, community scores, and next replies better when given a user's multi-turn conversation history, and it releases public data and code.