Paper Citation Record · LEDGER

Provable Offline Preference-Based Reinforcement Learning

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 16 inbound Pith citation observations for arXiv:2305.14816.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2305.14816 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 16 of 16 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T19:20:13.002840Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T23:29:02.979336Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation ba8ba420-fd18-4f34-b324-9b965813f310 · inbound

Combinatorial Reinforcement Learning with Preference Feedback cites this paper.

Combinatorial Reinforcement Learning with Preference Feedback Provable Offline Preference-Based Reinforcement Learning

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-07T19:20:13.002840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4c1e7082-13de-40a7-a7a9-ffe05b95f5db · inbound

A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO cites this paper.

A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO Provable Offline Preference-Based Reinforcement Learning

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-07T15:19:09.500623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 16c687fe-e2a0-4cef-b0f2-4cef349d565e · inbound

Outcome-Based Online Reinforcement Learning: Algorithms and Fundamental Limits cites this paper.

Outcome-Based Online Reinforcement Learning: Algorithms and Fundamental Limits Provable Offline Preference-Based Reinforcement Learning

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-07T14:10:43.538251Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a3074639-539a-49a7-97b8-496c5ef4f467 · inbound

Learning a Pessimistic Reward Model in RLHF cites this paper.

Learning a Pessimistic Reward Model in RLHF Provable Offline Preference-Based Reinforcement Learning

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-07T14:01:06.936809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be121500-6594-443b-9b65-15b395ac386f · inbound

Thompson Sampling in Online RLHF with General Function Approximation cites this paper.

Thompson Sampling in Online RLHF with General Function Approximation Provable Offline Preference-Based Reinforcement Learning

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-07T12:43:50.030374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation faa4c54d-4083-4620-95f4-cb0d669efcad · inbound

Best-of-N through the Smoothing Lens: KL Divergence and Regret Analysis cites this paper.

Best-of-N through the Smoothing Lens: KL Divergence and Regret Analysis Provable Offline Preference-Based Reinforcement Learning

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-06T19:28:59.418783Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73973510-7d79-4868-92e3-2ab89a0ef4cb · inbound

Semiparametric Preference Optimization: Your Language Model is Secretly a Single-Index Model cites this paper.

Semiparametric Preference Optimization: Your Language Model is Secretly a Single-Index Model Provable Offline Preference-Based Reinforcement Learning

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-03T14:03:36.586968Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c8d5c55-211b-4cc2-88ee-685fe1b9f111 · inbound

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution cites this paper.

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution Provable Offline Preference-Based Reinforcement Learning

Reference 38

Resolution: verified exact; arxiv_id, observed 2026-05-16T06:37:28.562069Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 072c8af7-3370-41b3-a0c1-ca10dfdcd607 · inbound

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution cites this paper.

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution Provable Offline Preference-Based Reinforcement Learning

Reference 38

Resolution: verified exact; arxiv_id, observed 2026-05-21T13:10:10.495290Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation efb1a5a2-635e-408b-865b-236fb3a78783 · inbound

Corruption-robust Offline Multi-agent Reinforcement Learning From Human Feedback cites this paper.

Corruption-robust Offline Multi-agent Reinforcement Learning From Human Feedback Provable Offline Preference-Based Reinforcement Learning

Reference 15

Resolution: verified exact; arxiv_id, observed 2026-05-14T21:19:29.063328Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation cf716446-1873-4fa2-9096-1d4cc83eddd8 · inbound

OPRIDE: Offline Preference-based Reinforcement Learning via In-Dataset Exploration cites this paper.

OPRIDE: Offline Preference-based Reinforcement Learning via In-Dataset Exploration Provable Offline Preference-Based Reinforcement Learning

Reference 56

Resolution: verified exact; arxiv_id, observed 2026-05-15T21:40:20.967674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation ad244cf2-7e9a-4b06-b231-43d295016ddc · inbound

Policy Gradient Primal-Dual Method for Safe Reinforcement Learning from Human Feedback cites this paper.

Policy Gradient Primal-Dual Method for Safe Reinforcement Learning from Human Feedback Provable Offline Preference-Based Reinforcement Learning

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-05-11T13:06:03.890094Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation f8da3cfa-a9c5-4e30-8936-b6b158725598 · inbound

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability cites this paper.

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability Provable Offline Preference-Based Reinforcement Learning

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-12T06:56:31.090069Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation a6624355-e3cf-4a8d-ae53-9721c458c5cb · inbound

When Does Trajectory-Level Supervision Permit Efficient Offline Reinforcement Learning? cites this paper.

When Does Trajectory-Level Supervision Permit Efficient Offline Reinforcement Learning? Provable Offline Preference-Based Reinforcement Learning

Reference 17

Resolution: verified exact; arxiv_id, observed 2026-07-03T23:29:02.980864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 4f46e08b-8347-4ca8-8c67-e650cc688904 · inbound

Multi-Turn On-Policy Distillation with Prefix Replay cites this paper.

Multi-Turn On-Policy Distillation with Prefix Replay Provable Offline Preference-Based Reinforcement Learning

Reference 228

Resolution: unresolved; no resolver link, observed 2026-07-11T13:53:36.775836Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 454061c9-42bb-493b-b17a-5224417792c2 · inbound

Multi-Turn On-Policy Distillation with Prefix Replay cites this paper.

Multi-Turn On-Policy Distillation with Prefix Replay Provable Offline Preference-Based Reinforcement Learning

Reference 229

Resolution: unresolved; no resolver link, observed 2026-08-02T08:40:58.612845Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.