PAIR-Bench defines a progressive hinting protocol with failure-region and hint-depth controls to measure LLM code refinement trajectories in detail.
Evaluating language models for efficient code generation,
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
fields
cs.SE 2years
2026 2representative citing papers
Auditing three performance-optimization benchmarks shows reference-patch validity collapses under cross-machine replay, rankings depend on scoring rules, and 384 of 450 replay-valid tasks are already solved by at least one public submission.
citing papers explorer
-
Benchmarking Code Improvement with Progressive, Adaptive, and Interactive Feedback
PAIR-Bench defines a progressive hinting protocol with failure-region and hint-depth controls to measure LLM code refinement trajectories in detail.
-
Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?
Auditing three performance-optimization benchmarks shows reference-patch validity collapses under cross-machine replay, rankings depend on scoring rules, and 384 of 450 replay-valid tasks are already solved by at least one public submission.