A new evaluation benchmark shows that leading LLMs perform poorly at tool selection when they must jointly reason about user profiles and environmental factors.
This means: - Demographic Coherence: The combination of age, gender, height, weight, occupation, and income should form a believable profile
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
ToolSpectrum : Towards Personalized Tool Utilization for Large Language Models
A new evaluation benchmark shows that leading LLMs perform poorly at tool selection when they must jointly reason about user profiles and environmental factors.