Paper Citation Record · LEDGER

Fusing Reward and Dueling Feedback in Stochastic Bandits

As of 19 August 2026, this Paper Citation Record lists 37 of 37 outbound references and 1 inbound Pith citation observation for arXiv:2504.15812.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.15812 v1

Coverage vector

measured 37 of 37 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T11:26:28.023566Z

measured 38 of 38 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-08T11:34:19.258512Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T19:36:13.482957Z

Reference resolution

37 of 37 outbound references displayed

verified exact1
verified fuzzy14
unresolved22
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation da95bc04-4358-408a-9646-d6b8a7a366cf · outbound

This paper cites Improved algorithms for linear stochastic bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Improved algorithms for linear stochastic bandits

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.912569Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8641145e-155e-4d28-a5b4-56a996489663 · outbound

This paper cites Reducing dueling bandits to cardinal bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Reducing dueling bandits to cardinal bandits

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.916058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation abfb73c0-70b3-4592-9542-49308f27734f · outbound

This paper cites Using confidence bounds for exploitation-exploration trade-offs.

Fusing Reward and Dueling Feedback in Stochastic Bandits Using confidence bounds for exploitation-exploration trade-offs

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.918940Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a9cb56b2-6511-4aa0-8461-d2b0c0f39069 · outbound

This paper cites and Ortner, R.

Fusing Reward and Dueling Feedback in Stochastic Bandits and Ortner, R

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.299414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e49611b4-babd-4f79-a02a-1a5cdd7bc54d · outbound

This paper cites an unresolved cited work.

Fusing Reward and Dueling Feedback in Stochastic Bandits Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:26:28.290627Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ec4067e4-2020-4531-9bd5-6526587055cd · outbound

This paper cites Online Learning and Bandits with Queried Hints.

Fusing Reward and Dueling Feedback in Stochastic Bandits Online Learning and Bandits with Queried Hints

Reference 6

Resolution: verified exact; local_arxiv, observed 2026-08-16T11:26:28.093365Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 95da1968-fc23-4f17-a86f-fb08a005ab0e · outbound

This paper cites Bandits games and clustering foundations.

Fusing Reward and Dueling Feedback in Stochastic Bandits Bandits games and clustering foundations

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.281657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 9ea97d07-b67a-4b45-96a5-5795d56bebe8 · outbound

This paper cites Regret analysis of stochastic and nonstochastic multi-armed bandit problems.

Fusing Reward and Dueling Feedback in Stochastic Bandits Regret analysis of stochastic and nonstochastic multi-armed bandit problems

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.273168Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1229c264-8c7a-4c4f-a734-8e226e4fe506 · outbound

This paper cites Kullback-leibler upper confidence bounds for optimal sequential allocation.

Fusing Reward and Dueling Feedback in Stochastic Bandits Kullback-leibler upper confidence bounds for optimal sequential allocation

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.264473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e28f4d59-b268-451e-8539-e332c1032733 · outbound

This paper cites Combinatorial multi-armed bandit: General framework and applications.

Fusing Reward and Dueling Feedback in Stochastic Bandits Combinatorial multi-armed bandit: General framework and applications

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.941236Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4778f404-d45c-4f15-9964-453f651d3f38 · outbound

This paper cites Leveraging initial hints for free in stochastic linear bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Leveraging initial hints for free in stochastic linear bandits

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.250470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1744d793-f794-4568-8967-d4b05fe3a198 · outbound

This paper cites and Takemura, A.

Fusing Reward and Dueling Feedback in Stochastic Bandits and Takemura, A

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.947306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation badb5ea3-3f00-44ec-a56a-facf1f0a8407 · outbound

This paper cites Provable Benefits of Policy Learning from Human Preferences in Contextual Bandit Problems.

Fusing Reward and Dueling Feedback in Stochastic Bandits Provable Benefits of Policy Learning from Human Preferences in Contextual Bandit Problems

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.949991Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b68548a0-716c-4ed6-a949-d7f44193029f · outbound

This paper cites Regret lower bound and optimal algorithm in dueling bandit problem.

Fusing Reward and Dueling Feedback in Stochastic Bandits Regret lower bound and optimal algorithm in dueling bandit problem

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.235378Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 8abb0548-3f25-491c-9aa6-3e8450b9550f · outbound

This paper cites an unresolved cited work.

Fusing Reward and Dueling Feedback in Stochastic Bandits Unresolved cited work

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.955799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b5951fdd-7891-4fd5-a09a-36bb5d1b7f13 · outbound

This paper cites and Szepesv \'a ri, C.

Fusing Reward and Dueling Feedback in Stochastic Bandits and Szepesv \'a ri, C

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.958731Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1331cd2d-e465-49dc-8f34-75795c47aad8 · outbound

This paper cites an unresolved cited work.

Fusing Reward and Dueling Feedback in Stochastic Bandits Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.961510Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 385e472a-2f51-4f3b-8361-4a202634539f · outbound

This paper cites FedConPE: Efficient Federated Conversational Bandits with Heterogeneous Clients.

Fusing Reward and Dueling Feedback in Stochastic Bandits FedConPE: Efficient Federated Conversational Bandits with Heterogeneous Clients

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.964233Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c4e6dd19-4977-4228-9fa2-4b70c6d31105 · outbound

This paper cites Predictive bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Predictive bandits

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.209879Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 6c36c2ed-5cfe-4df9-8317-9a92750278ea · outbound

This paper cites Online Learning: A Modern Introduction Using Convex Optimization.

Fusing Reward and Dueling Feedback in Stochastic Bandits Online Learning: A Modern Introduction Using Convex Optimization

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.970502Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a8566238-90c5-4e1c-8d00-83b638a7f7d7 · outbound

This paper cites Training language models to follow instructions with human feedback.

Fusing Reward and Dueling Feedback in Stochastic Bandits Training language models to follow instructions with human feedback

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.974021Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a35474b1-5f3b-47b4-a798-54900651ec60 · outbound

This paper cites D., Ermon, S., and Finn, C.

Fusing Reward and Dueling Feedback in Stochastic Bandits D., Ermon, S., and Finn, C

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.976926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 27dae902-6484-4326-8333-a136e8eb860b · outbound

This paper cites and Gaillard, P.

Fusing Reward and Dueling Feedback in Stochastic Bandits and Gaillard, P

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.190216Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation df60c913-3808-40a8-bc17-823aeb6631f6 · outbound

This paper cites Adversarial dueling bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Adversarial dueling bandits

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.181819Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation cc7c96b8-eb21-4a36-aeff-7036b49e9a89 · outbound

This paper cites Introduction to multi-armed bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Introduction to multi-armed bandits

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.985879Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9efd110b-a94a-425a-9fab-213ee64c2fbc · outbound

This paper cites Advancements in dueling bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Advancements in dueling bandits

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.173745Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation cde7e502-452d-42db-b33a-a41576798b3e · outbound

This paper cites S., Barto, A.

Fusing Reward and Dueling Feedback in Stochastic Bandits S., Barto, A

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.992859Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d2af2e41-4d79-47fc-b6a8-91c1df46c467 · outbound

This paper cites Algorithms for reinforcement learning.

Fusing Reward and Dueling Feedback in Stochastic Bandits Algorithms for reinforcement learning

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:27.996006Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f26268ef-941e-46ba-8bfb-5d0e3ed82d7d · outbound

This paper cites Generic exploration and k-armed voting bandits.

Fusing Reward and Dueling Feedback in Stochastic Bandits Generic exploration and k-armed voting bandits

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.155100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1889f57a-1754-46e2-aa64-b63558dcbddc · outbound

This paper cites Is RLHF More Difficult than Standard RL?.

Fusing Reward and Dueling Feedback in Stochastic Bandits Is RLHF More Difficult than Standard RL?

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:28.002503Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e683b71-0839-4829-acaa-773fd1fcf329 · outbound

This paper cites an unresolved cited work.

Fusing Reward and Dueling Feedback in Stochastic Bandits Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-08-16T11:26:28.146612Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 66522df1-fb9f-41b7-a3d3-3b2240536954 · outbound

This paper cites Iterative preference learning from human feedback: Bridging theory and practice for rlhf under kl-constraint.

Fusing Reward and Dueling Feedback in Stochastic Bandits Iterative preference learning from human feedback: Bridging theory and practice for rlhf under kl-constraint

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:28.008906Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c0bc00a5-59cf-4316-a1c8-059998ba029d · outbound

This paper cites L., Craswell, N., Voorhees, E.

Fusing Reward and Dueling Feedback in Stochastic Bandits L., Craswell, N., Voorhees, E

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.132593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ce8bcfb3-25fa-448f-b268-22d5b455dfb3 · outbound

This paper cites The k-armed dueling bandits problem.

Fusing Reward and Dueling Feedback in Stochastic Bandits The k-armed dueling bandits problem

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:28.014581Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17366d05-a6f8-4780-b2f5-76e1297ab72d · outbound

This paper cites Multi-armed bandit with additional observations.

Fusing Reward and Dueling Feedback in Stochastic Bandits Multi-armed bandit with additional observations

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.118696Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a2ab13f3-d9ea-46ec-836b-532c87a6817a · outbound

This paper cites Conversational contextual bandit: Algorithm and application.

Fusing Reward and Dueling Feedback in Stochastic Bandits Conversational contextual bandit: Algorithm and application

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T11:26:28.109362Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 65e54e4e-bbd2-48a7-b69f-fb172ddfef67 · outbound

This paper cites write newline.

Fusing Reward and Dueling Feedback in Stochastic Bandits write newline

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-16T11:26:28.023566Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 1fbed955-ec04-4fc6-8faf-ca4e1ae5031d · inbound

Best Arm Identification in Generalized Linear Bandits via Hybrid Feedback cites this paper.

Best Arm Identification in Generalized Linear Bandits via Hybrid Feedback Fusing Reward and Dueling Feedback in Stochastic Bandits

Reference 7

Resolution: verified exact; arxiv_id, observed 2026-05-11T19:36:13.487443Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.