Pith. sign in

Paper Citation Record · LEDGER

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem

As of 16 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 0 inbound Pith citation observations for arXiv:1908.07808.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
1908.07808 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-14T12:00:35.239845Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

30 of 30 outbound references displayed

  • verified exact2
  • verified fuzzy25
  • unresolved3
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a7dac931-384d-436c-9800-50c6a2cdc109 · outbound

This paper cites SIAM journal on control and optimization 33(6):1926--1951.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem SIAM journal on control and optimization 33(6):1926--1951

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.915132Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.879122Z digest=sha256:e01e5cb45bb703f8a72c8f8193ba0ec9bd1609cd9d86966777e23c98f09cf506

Observation 8975f173-e7cf-4912-ba46-18a115e3e25b · outbound

This paper cites Analysis of Thompson Sampling for the multi-armed bandit problem.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Analysis of Thompson Sampling for the multi-armed bandit problem

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-14T12:00:34.891992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-14T12:00:34.891992Z digest=sha256:80097aa5afdd7a4d3cc777bc3abc9e58f3ba825389e859c8a8f52531b990c91e

Observation 0352575e-90a5-4e82-9d44-0d53fd11df69 · outbound

This paper cites Springer.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Springer

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.864492Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.909861Z digest=sha256:d7e19c7e85e9dd9a28ec854b80c9e6d6351086ce8336b331c9006925bc4fd7dd

Observation 56730017-92b3-41a3-be4c-a5d3c4fbc459 · outbound

This paper cites In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, (AISTATS-11), pp 19--26.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, (AISTATS-11), pp 19--26

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.831148Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.925397Z digest=sha256:639e1a7a03fd948937b761b7fae5c579736fff8a23d25eb9f33827f27246bf5b

Observation 10b45747-fba7-436a-8c29-9ad268c88d3e · outbound

This paper cites John Wiley & Sons.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem John Wiley & Sons

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.798464Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.938188Z digest=sha256:ad08f0f2cfd36415812f81661916b4a705294369adfce57ac345e7b4f639640e

Observation 8881d11a-198b-41fc-8ac3-281a9ecb7254 · outbound

This paper cites Foundations and Trends in Machine Learning 5(1):1--122.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Foundations and Trends in Machine Learning 5(1):1--122

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.756802Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.945021Z digest=sha256:7840e7563270b95a5fe6da15d9790033ae5a1f3b80c1c6cb7f7ca152545bda13

Observation 8551504c-6531-4ffe-99ef-f0790eb1f15d · outbound

This paper cites In: Proceedings of the third ACM international conference on Web search and data mining, ACM, pp 351--360.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Proceedings of the third ACM international conference on Web search and data mining, ACM, pp 351--360

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.675160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.956158Z digest=sha256:7af433da0937504c470140c7be55498e73227573702098042b110c99b289747b

Observation 28a75f42-17c1-46a2-8889-6ba83caec364 · outbound

This paper cites In: Advances in Neural Information Processing Systems, pp 1025--1033.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Advances in Neural Information Processing Systems, pp 1025--1033

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.612314Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.967207Z digest=sha256:51a96265dd05947f1e1217c979bf2d24b405115ffdb354284237f50e0278f27d

Observation 749006d8-86a2-4a71-ac25-90c1a611cb60 · outbound

This paper cites Marketing Science 28(2):202--223.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Marketing Science 28(2):202--223

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.562898Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.975360Z digest=sha256:3d3fdd44a032b637ddbfc946b54d6d62f9ebf4532c0e914bf4b27411c33c1b3e

Observation 35ff7a10-b9c8-4476-86bc-23ab382a0e7b · outbound

This paper cites Journal of artificial intelligence research 4:237--285.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Journal of artificial intelligence research 4:237--285

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.522802Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.982947Z digest=sha256:529090b20bbf12053a14d0c072679aab01d77c3755590821bc25ce51f416a256

Observation d776919c-e747-40c4-855d-b642f44527ec · outbound

This paper cites Lock in Feedback in Sequential Experiments.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Lock in Feedback in Sequential Experiments

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-08-14T12:00:35.564928Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:34.996205Z digest=sha256:5084dab965c61b3bbe42298c9bb1a857dd370157f1d207fc33a03a94e9bb688f

Observation 5c925040-f8be-405a-ad03-301d90b41589 · outbound

This paper cites StreamingBandit; Experimenting with Bandit Policies.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem StreamingBandit; Experimenting with Bandit Policies

Reference 12

Resolution
verified exact
local_arxiv, observed 2026-08-14T12:00:35.468574Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.005829Z digest=sha256:abad73196f0cf33d7726b9f998fe3bfe685073ad97ff0ed0cfaad3f2d25f2f8d

Observation 8382c07c-d34e-46f4-8691-7a92f3ee03e3 · outbound

This paper cites Palgrave Communications 2.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Palgrave Communications 2

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.452248Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.012903Z digest=sha256:97ab6a34bbd36a7835d5ab4a926cfd53481b2098b98c364c016bb6f6b80e890b

Observation 00ca3d74-4e09-44ec-afb2-b868dd527bba · outbound

This paper cites In: Advances in Neural Information Processing Systems, vol 17, pp 697--704.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Advances in Neural Information Processing Systems, vol 17, pp 697--704

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.388014Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.025223Z digest=sha256:e016552cbd2bd597956ab016efa2d18dfe81a4b882bceb7325aebce87ff0012e

Observation 5aa9f571-6835-46fa-8977-da6ae760ea77 · outbound

This paper cites In: Advances in Neural Information Processing Systems, pp 2447--2455.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Advances in Neural Information Processing Systems, pp 2447--2455

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.344730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.043761Z digest=sha256:7a463962ed93d707d0b2d96c4e20505718d4919d3b1ccaf1eb85bc3d39683603

Observation fec22e0e-600f-4b49-8ffd-c940ee03ad37 · outbound

This paper cites Algorithms for multi-armed bandit problems.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Algorithms for multi-armed bandit problems

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-14T12:00:35.065266Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-14T12:00:35.065266Z digest=sha256:6fca6eea459c573936b7db28d785b1f84247e4d490bdb311dee8c84ce6e68cd9

Observation 89434868-c67b-43a8-b774-78141f22edca · outbound

This paper cites Advances in Applied Mathematics 6(1):4--22.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Advances in Applied Mathematics 6(1):4--22

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.292894Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.075785Z digest=sha256:2993d9e4467cf4ea6856259694cd162af99b0a134f5a77a0bc77c2a921c68152

Observation 3a857df8-2a72-4e8f-a798-b48175d358ca · outbound

This paper cites In: Advances in Neural Information Processing Systems, pp 817--824.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Advances in Neural Information Processing Systems, pp 817--824

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.234480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.085054Z digest=sha256:de2e3db9c30ac503911c2774329b73d4f6994a6765b15b9f1e8ce2c898790ca3

Observation 4e98384e-8850-4d4a-ac01-f533ac9a1024 · outbound

This paper cites A Contextual-Bandit Approach to Personalized News Article Recommendation.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem A Contextual-Bandit Approach to Personalized News Article Recommendation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-14T12:00:35.091557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-14T12:00:35.091557Z digest=sha256:f52bd497ac62318062f0800f171ddda486a377e7fbcc56d0708a73aa4c397903

Observation da0353ef-b242-467c-91a8-8599670476b8 · outbound

This paper cites In: Proceedings of the fourth ACM international conference on Web search and data mining, ACM, pp 297--306.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Proceedings of the fourth ACM international conference on Web search and data mining, ACM, pp 297--306

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.171573Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.100617Z digest=sha256:b4f6a7ab26fddc3eb251c401d56b0ab401352fcb4d1888d725e466fc6eaa64a1

Observation 05c0cf8b-a143-41b3-8a7c-8addbf33107e · outbound

This paper cites In: Proceedings of the National Academy of Sciences, vol 106, pp 22,387--22,392.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: Proceedings of the National Academy of Sciences, vol 106, pp 22,387--22,392

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.121827Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.107177Z digest=sha256:d821ae4f4d499e8d0bb3f2ecbedb425148b2b737fcedcf4e77c56c078f867102

Observation cc428034-df84-47bd-b041-20441768407b · outbound

This paper cites American Journal of Physics 62(2):129.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem American Journal of Physics 62(2):129

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.082902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.117268Z digest=sha256:b0e20af53cc72b140a5c84fd0648148498444fbb7f0d3604728811f6058e3398

Observation 20051bbe-898e-4bf6-9e59-8223369d905f · outbound

This paper cites Applied Stochastic Models in Business and Industry 26(6):639--658.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Applied Stochastic Models in Business and Industry 26(6):639--658

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:36.017963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.126199Z digest=sha256:6bd5716400478526592b49bb4661748412c9da9065d994a5a6fbb89c228836e8

Observation 6c2b88c5-1f32-4075-b827-0495b9ddee09 · outbound

This paper cites MIT press.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem MIT press

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:35.927099Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.133785Z digest=sha256:72701421aea335b99d4c30af15f2b6435526bafcd04e3dac152f1a0c682543c9

Observation cc2a690c-fe2f-4da2-8036-5678508492ae · outbound

This paper cites In: AAAI, pp 3000--3006.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem In: AAAI, pp 3000--3006

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:35.866508Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.146931Z digest=sha256:a7889a3be724315f10483c1383ab13d6a2cb0c2a2ead3940b4bfcdab17b1f23f

Observation 86904172-0cf6-4f77-a31d-238bdebd3a1a · outbound

This paper cites Biometrika (3-4):285--294.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Biometrika (3-4):285--294

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:35.826215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.159333Z digest=sha256:df2e65b63facb62462632e46692c5a09c8f0844d5a5f6c7a675c40d50e27b9cf

Observation 130c43c1-e4ed-4a3e-be3a-a5ba36292181 · outbound

This paper cites IEEE Transactions on Automatic Control 50(3):338--355.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem IEEE Transactions on Automatic Control 50(3):338--355

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:35.788134Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.166548Z digest=sha256:4ab4a0bf48587956ead194a6ed4e8f3de0a4a27a35441f8c4100f97d6236ec2f

Observation 1cddb340-86a3-48b2-92f2-97875ce73a11 · outbound

This paper cites Journal of the Royal Statistical Society Series B Methodological 42(2):143--149.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Journal of the Royal Statistical Society Series B Methodological 42(2):143--149

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:35.753719Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.183394Z digest=sha256:307f2eae9a9301ec257a9cd78054814feaa099b2bb764d0806865b196c21fb80

Observation d24ee197-f7a9-4cb2-8ca3-a451e3cb411a · outbound

This paper cites Computational Statistics & Data Analysis 113:136--153.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Computational Statistics & Data Analysis 113:136--153

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:35.684728Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.198538Z digest=sha256:75e686d642a994c1f346180f4f4e8b1c6b8ecb4a235987586cf9c4a5149d3c8e

Observation 03ab3066-ed16-47fe-90f7-b7d80e83de1b · outbound

This paper cites Am J Phys 59(6):569--572.

Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem Am J Phys 59(6):569--572

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T12:00:35.652687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-08-14T12:00:35.239845Z digest=sha256:dbd0126866e72a578bc472d3fae97ba10dd905d4fe305333bd471109d7a95c3e

Pith citing papers

No inbound Pith citation observations are available.