Pith. sign in

Paper Citation Record · LEDGER

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits

As of 23 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 0 inbound Pith citation observations for arXiv:2608.11560.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.11560 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T00:41:32.038712Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

30 of 30 outbound references displayed

  • verified exact3
  • verified fuzzy8
  • unresolved19
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 6520674d-b2b0-400f-86e3-9e2f509dff15 · outbound

This paper cites Imbens, and Hyunseung Kang.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Imbens, and Hyunseung Kang

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.593017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.886344Z digest=sha256:b024ebe19ccdfc857edfd31e9ba108a2135e39036d8aca57b5779a50d56d46a7

Observation 3dbe2a08-4f21-47a6-8555-139148c634fb · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.580168Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.891924Z digest=sha256:44665c512bca836ece25a9a592b9e78bca9772bcc3e7e05d01cf30097935e762

Observation 7643c82b-a687-4d0e-bf3a-b7b07bef4dff · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.565931Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.896903Z digest=sha256:a4b343ade0957bc14563eb4a8b1ed4224e806933526a880a4c2409ed9b099239

Observation 0cf5338b-93f7-4a9d-954c-ce361489e27e · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.552631Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.902148Z digest=sha256:564ec6f0851527010008d9b752ba606849efc2b4e0551bbfcca3734bd00066f6

Observation 44c94867-1459-4bfd-9b69-47ebf26d1608 · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.538516Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.906850Z digest=sha256:6622532568f1d4b468ff6d21595ccd919753d64be0ada6cd342042a87e5c11c1

Observation d3602be4-c0bd-4dd0-aee9-fa224604a91d · outbound

This paper cites Hitsch, Sanjog Misra, and Walter W.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Hitsch, Sanjog Misra, and Walter W

Reference 6

Resolution
verified exact
doi, observed 2026-08-16T00:41:32.076113Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.911238Z digest=sha256:eddaa71f67133d5b16e41ca098c4ccfe4ebb3d5146f0ab394bd45389ff52e243

Observation c9cb16eb-4061-4e79-b425-509b6b18a46f · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.523823Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.916716Z digest=sha256:2b79aee4ba7c0eba4e277a0547cd74811626d2fcfd74c4e7072b7c7d3923ba5a

Observation f6725adf-24c9-4247-9302-b070e868da99 · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.509727Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.922436Z digest=sha256:95db3dfafa3c540243683b685e1e4ffc357a9d66844e609546aad954580c9654

Observation 93e97633-d5ce-4f3a-9d80-6dcb729c242c · outbound

This paper cites 2020.Trustworthy Online Controlled Experi- ments: A Practical Guide to A/B Testing.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits 2020.Trustworthy Online Controlled Experi- ments: A Practical Guide to A/B Testing

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-16T00:41:31.927681Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:41:31.927681Z digest=sha256:8e3e88691929e033b6a89793926517a29bb8c50cccfbd92e6c80be9747f0c48a

Observation 69a1633f-6f2f-4f94-9dbc-5bdc43e593eb · outbound

This paper cites Schapire.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Schapire

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.487320Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.932438Z digest=sha256:7e53f6f467d7dfe814b003ea3a86eb72465f8ec5591e6523405043f87ce7ee5b

Observation 73a5db08-ed12-41cb-b3dc-e53d71e1133f · outbound

This paper cites Unbiased Offline Evaluation of Contextual-bandit-based News Article Recommendation Algorithms.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unbiased Offline Evaluation of Contextual-bandit-based News Article Recommendation Algorithms

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-08-16T00:41:32.261437Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.938685Z digest=sha256:0ba8102d02056aa59a47f8e1999ad6bdda3c787636f803c07a52d1989d78812e

Observation f0016b7b-d651-4bec-b5ba-cf4f17bb6e5c · outbound

This paper cites Categorizing Variants of Goodhart's Law.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Categorizing Variants of Goodhart's Law

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-16T00:41:31.946714Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:41:31.946714Z digest=sha256:bdd7749312aaed8c74a20751a0d5f3c71e44a44c7496d21b9280b6bd38bc2443

Observation 4ab43355-22ca-40d6-afc1-f209067b64b5 · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.474407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.954108Z digest=sha256:795e721c6f0ac70e90c60db64200eb5d293ed73d0d4b55444ed6b718f29c0ab8

Observation eaacf798-4130-4ac0-b1f1-a7dfdae7bdfb · outbound

This paper cites Ng, Daishi Harada, and Stuart Russell.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Ng, Daishi Harada, and Stuart Russell

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.445696Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.971240Z digest=sha256:1a7190d0e747dfde2ade76833882a0592f3f076471d6c60a496ea1c3ea447bd8

Observation 34e26eb6-82f3-4235-8f58-7e60d058e875 · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.431808Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.975560Z digest=sha256:907a77980c79a44165dea06c8641c34b97f03bcffead9b7d313adec32b8201fb

Observation cb35ae64-b59f-4c9c-aebd-775db9b07d7b · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.417423Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.980166Z digest=sha256:e38a7e1ab6ad98fa837000d941e6fef07c74649cd421b13a18a87930fe4ca76c

Observation 158bf5f9-1be5-4fa1-a599-ed4bf8d84b62 · outbound

This paper cites Prentice.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Prentice

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.388590Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.989098Z digest=sha256:6cbd6d144791497be6a0321a23e089637f98fe535c5267afdb16508089384547

Observation 4566d10c-a888-4523-8227-05d9157ed1d8 · outbound

This paper cites Roijers, Peter Vamplew, Shimon Whiteson, and Richard Dazeley.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Roijers, Peter Vamplew, Shimon Whiteson, and Richard Dazeley

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-16T00:41:31.993243Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:41:31.993243Z digest=sha256:392ccdfae37876e5363d6df6856939c96075253dacfb62178d52803cb3fb766c

Observation 6e8f8f9c-daf3-499f-bd49-0a4c6de68077 · outbound

This paper cites Open Bandit Dataset and Pipeline: Towards Realistic and Reproducible Off-Policy Evaluation.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Open Bandit Dataset and Pipeline: Towards Realistic and Reproducible Off-Policy Evaluation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-16T00:41:32.001981Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:41:32.001981Z digest=sha256:535e30d40c254279b9b723777da4ee3f15e024163ddcc143e2c27e21808503a6

Observation 3ef44ebd-c343-4f56-8f1d-85f143fb4756 · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-16T00:41:32.007049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:41:32.007049Z digest=sha256:0f3a7d69ccc2dda111e0d61fbb018a703ed2c6058f18c240f05b721d50a99a0c

Observation f788253d-c6d0-4b6e-970d-5ca14d2ca62c · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-16T00:41:32.011376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:41:32.011376Z digest=sha256:e60004e7454fbf02eea6c0563752eb9022e055f553d0c71d47e1652e16ab02fb

Observation abb78ce0-28c4-4fe4-8b0a-90d9dda1f362 · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.328245Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:32.020725Z digest=sha256:784472d7c9f7d27de2ddb1014d7786794e48d6d34c739c0de305d368e6352185

Observation 7bc5112d-7800-49e9-bb6f-a044645e504f · outbound

This paper cites Choosing a Proxy Metric from Past Experiments.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Choosing a Proxy Metric from Past Experiments

Reference 23

Resolution
verified exact
local_arxiv, observed 2026-08-16T00:41:32.112827Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:32.025017Z digest=sha256:843e0bdf62ce72b9c9e90e1c950c898772a3af3a855de41122b29d746aed47a8

Observation 45767498-29a0-41da-98ba-3040a5f2fef1 · outbound

This paper cites VanderWeele.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits VanderWeele

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.313057Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:32.029706Z digest=sha256:8b9c44ceaa06bdeccd6310da02b916ef4b7ff3dc06eff4708e0bb2b91fec620a

Observation 54d77dfb-20fc-4602-a09e-92e1885fe407 · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.299051Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:32.034462Z digest=sha256:37b1ce432bc481a13acc5fe24048bd9b0405e675ad7656f761a7ae37d42ca169

Observation 9d5a4b92-c198-4307-8cc6-d34cbef94587 · outbound

This paper cites Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learning.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learning

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-16T00:41:32.038712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:41:32.038712Z digest=sha256:6ea6f29d96b90404c55da91d3db7f49169cb2532aee33d73e5296cb474c2e928

Observation 7908cb71-40c0-4a00-9775-728bbabad23d · outbound

This paper cites an unresolved cited work.

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits Unresolved cited work

Reference 2013

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:41:32.365488Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.997400Z digest=sha256:b8af448a700276535dd700c0eacf1ee39bf5a4829705cba413f86dd4f8b70bae

Observation 4f47815e-df40-41e4-acb1-86351e4b03cd · outbound

This paper cites InProceedings of the 35th International Conference on Machine Learning (ICML).

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits InProceedings of the 35th International Conference on Machine Learning (ICML)

Reference 2018

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.403370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.984484Z digest=sha256:6dbd8a39ddfd290ac239c0a5d232569b54780666f2410508f032fbb7d36547b5

Observation 9a2a5e05-8cbd-4160-8603-709501a38f43 · outbound

This paper cites InAdvances in Neural Information Processing Systems (NeurIPS).

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits InAdvances in Neural Information Processing Systems (NeurIPS)

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.342456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:32.016154Z digest=sha256:0f9b61ddaa903d4098a071cb323fa9223763b7101473f18f21aebc85ce891d73

Observation a5c4782d-cdd8-4b16-a14e-c113d5d75aad · outbound

This paper cites InProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD).

When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits InProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:41:32.460709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:41:31.961619Z digest=sha256:916a3f81ee2bb32c4bf1ec90db1cae5b2ddffe6109e3bc02c70626792b5a734c

Pith citing papers

No inbound Pith citation observations are available.