Pith. sign in

REVIEW 21 cited by

LLM Critics Help Catch LLM Bugs

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.00215 v1 pith:SJ4L3HVG submitted 2024-06-28 cs.SE cs.LG

LLM Critics Help Catch LLM Bugs

classification cs.SE cs.LG
keywords criticshumanbugscodecatchhumanstaskscontractors
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Reinforcement learning from human feedback (RLHF) is fundamentally limited by the capacity of humans to correctly evaluate model output. To improve human evaluation ability and overcome that limitation this work trains "critic" models that help humans to more accurately evaluate model-written code. These critics are themselves LLMs trained with RLHF to write natural language feedback highlighting problems in code from real-world assistant tasks. On code containing naturally occurring LLM errors model-written critiques are preferred over human critiques in 63% of cases, and human evaluation finds that models catch more bugs than human contractors paid for code review. We further confirm that our fine-tuned LLM critics can successfully identify hundreds of errors in ChatGPT training data rated as "flawless", even though the majority of those tasks are non-code tasks and thus out-of-distribution for the critic model. Critics can have limitations of their own, including hallucinated bugs that could mislead humans into making mistakes they might have otherwise avoided, but human-machine teams of critics and contractors catch similar numbers of bugs to LLM critics while hallucinating less than LLMs alone.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 21 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Fantastic Adaptive Taxonomies and How to Use Them

    cs.SE 2026-07 conditional novelty 8.0

    AdaMAST induces a compact, evidence-grounded failure taxonomy from an agent's own traces and shows it improves agent-system search, runtime reflection, and trajectory selection over free-text and fixed-taxonomy baselines.

  2. BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

    cs.CL 2026-04 unverdicted novelty 8.0

    BenchGuard is the first LLM-based automated auditing framework for execution-based agent benchmarks, identifying 12 confirmed issues in ScienceAgentBench and matching 83.3% of expert findings on BIXBench at low cost.

  3. Beyond Binary: Reframing GUI Critique as Continuous Semantic Alignment

    cs.LG 2026-05 unverdicted novelty 7.0

    BBCritic reframes GUI critique as continuous semantic alignment via contrastive learning in an affordance space, outperforming larger binary SOTA models on a new four-level hierarchical benchmark without extra annotations.

  4. Beyond Binary: Reframing GUI Critique as Continuous Semantic Alignment

    cs.LG 2026-05 unverdicted novelty 7.0

    BBCritic uses contrastive learning to align GUI actions in a continuous affordance space, outperforming larger binary critic models on a new four-level hierarchical benchmark while enabling zero-shot transfer.

  5. LLM Wardens: Mitigating Adversarial Persuasion with Third-Party Conversational Oversight

    cs.LG 2026-05 unverdicted novelty 7.0

    A secondary warden LLM halves the success rate of hidden-goal adversarial LLMs in steering user decisions while causing only minor interference with genuine interactions.

  6. ReCodeAgent: A Multi-Agent Workflow for Language-agnostic Translation and Validation of Large-scale Repositories

    cs.SE 2026-04 unverdicted novelty 7.0

    ReCodeAgent uses a multi-agent system to translate and validate large code repositories across multiple programming languages, achieving 60.8% higher test pass rates than prior neuro-symbolic and agentic methods on 11...

  7. A dataset of rated conceptual arguments

    cs.AI 2026-07 conditional novelty 6.5

    A multi-dimensional expert-rated dataset of 951 conceptual-argument critiques shows LLM judge performance tracks general model capability and is little helped by reasoning modes.

  8. Beyond a Single Judge: The Evidence-Grounded, Social-Weighted Persona Panel for Generative UI Evaluation

    cs.CL 2026-07 conditional novelty 6.0

    A panel of five evidence-grounded LLM personas that deliberate and are socially weighted tracks human UI-quality ratings (r=0.922) far better than a single LLM judge (r=0.716).

  9. Beyond a Single Judge: The Evidence-Grounded, Social-Weighted Persona Panel for Generative UI Evaluation

    cs.CL 2026-07 conditional novelty 6.0

    Evidence-grounded persona panels with bounded-confidence deliberation raise GenUI judge–human correlation from 0.716 to 0.922, mostly from persona grounding rather than multi-prompt averaging.

  10. Proof-or-Stop: Don't Trust the Agent, Trust the Evidence -- Loop Engineering for Verifiable Evidence-Gated Lifecycle Control

    cs.AI 2026-07 conditional novelty 6.0

    Proof-or-Stop gates autonomous coding lifecycle transitions on fresh, source-state-bound, mechanically verifiable evidence, cutting visible-pass/hidden-fail amplification from 31/1800 to 2/1800 injected cells in a 9,2...

  11. Weak Critics Make Strong Learners: On-Policy Critique Distillation for Scalable Oversight

    cs.AI 2026-05 unverdicted novelty 6.0

    Weak models used as critics supplying non-misleading revision directions, distilled on-policy via OPCD, improve frozen and trained strong models on reasoning and alignment benchmarks.

  12. Philosophical Dispositions as Behavioral Constraints for AI-Assisted Code Review: An Empirical Study

    cs.SE 2026-05 unverdicted novelty 6.0

    An empirical evaluation of philosophical dispositions constraining AI code review on 50 PRs shows 46% human convergence, 75% unique findings, zero author-judged false positives, and 51% findings absent from generic prompting.

  13. AI Alignment via Incentives and Correction

    cs.LG 2026-05 unverdicted novelty 6.0

    AI alignment is framed as inducing equilibrium behavior in a solver-auditor interaction via adaptive rewards found by bandit optimization, yielding improved oversight and reduced errors in LLM coding experiments.

  14. AI Alignment via Incentives and Correction

    cs.LG 2026-05 unverdicted novelty 6.0

    AI alignment is reframed as a fixed-point incentive problem in a solver-auditor pipeline, solved via bilevel optimization and bandit search over reward profiles to maintain monitoring and reduce hallucinations in LLM ...

  15. Building a Precise Video Language with Human-AI Oversight

    cs.CV 2026-04 unverdicted novelty 6.0

    CHAI framework pairs AI pre-captions with expert human critiques to produce precise video descriptions, enabling open models to outperform closed ones like Gemini-3.1-Pro and improve fine-grained control in video gene...

  16. No More Stale Feedback: Co-Evolving Critics for Open-World Agent Learning

    cs.AI 2026-01 unverdicted novelty 6.0

    ECHO jointly optimizes policy and critic via co-evolution, cascaded rollouts, and saturation-aware shaping to deliver non-stale feedback and higher success in open-world LLM agent RL.

  17. Human-AI Complementarity: A Goal for Amplified Oversight

    cs.AI 2025-10 conditional novelty 6.0

    Confidence-based routing of fact-verification to humans, plus evidence-only AI assistance, beats either human or AI raters alone: 91.3% hybrid accuracy vs 87.7% for the AI rater.

  18. CoLD: Counterfactually-Guided Length Debiasing for Process Reward Models in Mathematical Reasoning

    cs.CL 2025-07 unverdicted novelty 6.0

    CoLD mitigates length bias in process reward models for mathematical reasoning via counterfactual guidance, length penalties, bias estimation, and joint training, improving step selection accuracy and conciseness on M...

  19. InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models

    cs.CV 2025-04 conditional novelty 6.0

    InternVL3-78B sets a new open-source SOTA of 72.2 on MMMU via native joint multimodal pre-training, V2PE, MPO, and test-time scaling while remaining competitive with proprietary models.

  20. Code Monitor Red Teaming for Public-Test-Passing Code

    cs.AI 2026-07 conditional novelty 5.0

    Weak LLM verifiers miss most hidden bugs in public-test-passing code, and adversarial pressure makes that monitoring worse.

  21. Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety

    cs.AI 2025-07 unverdicted novelty 5.0

    Chain-of-thought monitorability provides a promising but fragile method for AI safety oversight that developers should actively preserve.