AstaBench is a new benchmark suite for AI agents performing scientific research across domains, with evaluations of 57 agents showing that AI remains far from solving science research assistance.
For example, it would include specific names with some details of well-known medical datasets for ML like those mentioned in the examples
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2025 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite
AstaBench is a new benchmark suite for AI agents performing scientific research across domains, with evaluations of 57 agents showing that AI remains far from solving science research assistance.