Artificial Intelligence · arXiv:2604.00790 v2 · submitted 1 Apr 2026
RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning
The paper says
“These findings highlight self-refinement as a promising direction for scaling LLMs' general reasoning ability.”
from the abstract · picked out as the main claim by a classifier
Reviews
Reviews by people
No person has reviewed this paper on Pith yet. A scientist listed on Pith can review it for a fee, and their review is published here whatever it concludes.
The paper
Abstract
While large language models (LLMs) have demonstrated strong performance on complex reasoning tasks such as competitive programming (CP), existing methods predominantly focus on single-attempt settings, overlooking their capacity for iterative refinement. In this paper, we present RefineRL, a novel approach designed to unleash the self-refinement capabilities of LLMs for CP problem solving. RefineRL introduces two key innovations: (1) Skeptical-Agent, an iterative self-refinement agent equipped with local execution tools to validate generated solutions against public test cases of CP problems. This agent always remains skeptical of its own outputs and thereby enforces rigorous self-refinement even when validation suggests correctness. (2) A reinforcement learning (RL) solution to incentivize LLMs to self-refine with only standard RLVR data (i.e., problems paired with their verifiable answers). Extensive experiments on Qwen3-4B and Qwen3-4B-2507 demonstrate that our method yields substantial gains: after our RL training, these compact 4B models integrated with the Skeptical-Agent not only outperform much larger 32B models but also approach the single-attempt performance of 235B models. Notably, although our models are trained solely on CP coding data, RefineRL also substantially improves their performance on mathematical reasoning benchmarks, suggesting that the learned self-refinement behavior can transfer beyond coding-specific tasks. These findings highlight self-refinement as a promising direction for scaling LLMs' general reasoning ability.
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. No sentence in this record was written by a model.
abstract compiled · 2026-09-29 · no language-model review
How the main claim is stated: hedged possibility 0.56
What the abstract itself states, as probabilities: claims first 0.12 · states limitation 0.26 · human participants 0.03 · controlled comparison 0.66 · randomized assignment 0.01 · states quantitative result 0.83 · compares with prior results 0.91 · mentions code or data availability 0.03
The abstract, sentence by sentence
This table labels the abstract only (arXiv listing abstract v2). The number is the probability the classifier gave the label.
| Sentence | Role | The authors' own work | States the main conclusion | Strength |
|---|---|---|---|---|
| While large language models (LLMs) have demonstrated strong performance on complex reasoning tasks such as competitive programming (CP), existing methods predominantly focus on single-attempt settings, overlooking their capacity for iterative refinement. | gap 0.85 | 0.06 | 0.02 | asserted 1.00 |
| In this paper, we present RefineRL, a novel approach designed to unleash the self-refinement capabilities of LLMs for CP problem solving. | contribution 1.00 | 0.81 | 0.06 | asserted 0.98 |
| RefineRL introduces two key innovations: (1) Skeptical-Agent, an iterative self-refinement agent equipped with local execution tools to validate generated solutions against public test cases of CP problems. | contribution 0.56 | 0.87 | 0.04 | asserted 0.99 |
| This agent always remains skeptical of its own outputs and thereby enforces rigorous self-refinement even when validation suggests correctness. | method 0.96 | 0.60 | 0.04 | asserted 1.00 |
| (2) A reinforcement learning (RL) solution to incentivize LLMs to self-refine with only standard RLVR data (i.e., problems paired with their verifiable answers). | contribution 0.56 | 0.86 | 0.04 | asserted 0.95 |
| Extensive experiments on Qwen3-4B and Qwen3-4B-2507 demonstrate that our method yields substantial gains: after our RL training, these compact 4B models integrated with the Skeptical-Agent not only outperform much larger 32B models but also approach the single-attempt performance of 235B models. | result 1.00 | 0.97 | 0.37 | asserted 1.00 |
| Notably, although our models are trained solely on CP coding data, RefineRL also substantially improves their performance on mathematical reasoning benchmarks, suggesting that the learned self-refinement behavior can transfer beyond coding-specific tasks. | result 0.70 | 0.95 | 0.17 | hedged possibility 0.65 |
| These findings highlight self-refinement as a promising direction for scaling LLMs' general reasoning ability. | interpretation 1.00 | 0.54 | 0.75 | hedged possibility 0.56 |
What kind of paper the classifier reports this is: method or tool 1.00 · evidence from observation or experiment 1.00
What was examined, and what was not
Sources read
- arXiv listing abstract v2
Not examined
- full text
- figures and tables
- references and citing sentences
- relations to other papers
Levels run
- P abstract
Not run
- S sections
- T body sentences
- C citations
- R cross-paper relations
How the labels were made
Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-29: 1 request, 6,483 input tokens.
Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. This record as JSON
Cited by 2 Pith papers
Reviewed papers on Pith that cite this one. The full citation record
- Beyond the Verdict: Agentic Code Judging with Verifiable Feedback cs.AI · Oct 2026
- FC-SWE: Failure-Conditioned RL for Long-Horizon Software Engineering Agents cs.LG · Oct 2026
Challenges and discussion
Know something about this paper? Leave a comment.
Come back by email
A short list of the week's newly reviewed papers. Nothing is sent until you confirm from your inbox, and every email has a link that stops it. No account.
No comments yet.
Sign in to comment