A financial-agent benchmark with 220 open-ended queries and 11,543 source-attributed rubrics finds that the tool harness shapes performance more than the model alone, and that the authors' in-house system leads at 56%.
Hedge-Bench: Benchmarking Agents on Hard, Realistic Tasks Pertaining to Financial Reasoning
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
AI agents can increasingly handle the mechanical tasks of financial analysis: retrieving documents, calculating formulas, updating spreadsheets. The harder, more valuable challenge is reasoning through the open-ended questions that define expert Analyst work. Existing benchmarks do not capture this class of problem, and those that attempt to evaluate open-ended reasoning rely on model-judged outputs that introduce noise and circularity. We present Hedge-Bench 1.0: a benchmark of 102 actual, on-the-job tasks grounded in the explicit reasoning traces of professional hedge fund analysts working with relevant information sources. This approach enables deterministic grading against verified expert steps. Frontier models and agents score below 16\% on the benchmark. We publish the dataset and evaluation harness at github.com/Trata-Inc/trata-hedge-bench.
fields
cs.AI 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
FrontierFinance: A Challenging Benchmark for Measuring Frontier Intelligence of Finance Agents
A financial-agent benchmark with 220 open-ended queries and 11,543 source-attributed rubrics finds that the tool harness shapes performance more than the model alone, and that the authors' in-house system leads at 56%.