Paper Citation Record · LEDGER

Policy Optimization in RLHF: The Impact of Out-of-preference Data

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 4 inbound Pith citation observations for arXiv:2312.10584.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2312.10584 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 4 of 4 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T05:47:20.823057Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-06T13:49:14.654740Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation cbcaa8fe-2360-4a59-8d31-ee40a228821a · inbound

AnnoDPO: Protein Functional Annotation Learning with Direct Preference Optimization cites this paper.

AnnoDPO: Protein Functional Annotation Learning with Direct Preference Optimization Policy Optimization in RLHF: The Impact of Out-of-preference Data

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-07T05:47:20.823057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b7c6d022-71b5-42c7-90d9-c7b5bcbd23f7 · inbound

Explicit Preference Optimization: No Need for an Implicit Reward Model cites this paper.

Explicit Preference Optimization: No Need for an Implicit Reward Model Policy Optimization in RLHF: The Impact of Out-of-preference Data

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-07T05:40:17.937230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 37cfa10b-53f2-4d10-807e-fffd6a485e01 · inbound

Theoretical Tensions in RLHF: Reconciling Empirical Success with Inconsistencies in Social Choice Theory cites this paper.

Theoretical Tensions in RLHF: Reconciling Empirical Success with Inconsistencies in Social Choice Theory Policy Optimization in RLHF: The Impact of Out-of-preference Data

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-07T01:04:31.048119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6c8d9209-bf45-4f0c-b311-fe1ce12383eb · inbound

SGPO: Self-Generated Preference Optimization based on Self-Improver cites this paper.

SGPO: Self-Generated Preference Optimization based on Self-Improver Policy Optimization in RLHF: The Impact of Out-of-preference Data

Reference 18

Resolution: verified exact; local_arxiv, observed 2026-08-06T13:49:14.825066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.