Pith. sign in

Paper Citation Record · LEDGER

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling

As of 19 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 0 inbound Pith citation observations for arXiv:2608.10896.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.10896 v1

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T14:57:07.035055Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

16 of 16 outbound references displayed

  • verified exact8
  • verified fuzzy1
  • unresolved6
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 379b6935-8a79-4e3d-9c95-ff6926e2547e · outbound

This paper cites Dongyan Lucy Huo, Yudong Chen, and Qiaomin Xie.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Dongyan Lucy Huo, Yudong Chen, and Qiaomin Xie

Reference 4

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.188883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.975599Z digest=sha256:6ab1649c51d288232fc39c4d0425933acd5c5b0c90b29879565ede9da8d81e34

Observation b5cc44d7-cb48-4990-9911-58a6dd0f70da · outbound

This paper cites Nicholas M.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Nicholas M

Reference 5

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.576569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.980865Z digest=sha256:1b2451d6dcc0b00ff94489ded9d69caf50aed8c2ca412e551fc21e8442856cae

Observation 36064249-498c-46dc-a493-c2c15296e0e9 · outbound

This paper cites Revisiting Step-Size Assumptions in Stochastic Approximation.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Revisiting Step-Size Assumptions in Stochastic Approximation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:06.990142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:06.990142Z digest=sha256:ecc977c53a6ab7aeeddbe80facff19d72737971dc9894d742adb900a69556d9a

Observation 732ac268-c36f-4e81-80b6-410211f11ab2 · outbound

This paper cites Jiaqi Li, Zhipeng Lou, Stefan Richter, and Wei Biao Wu.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Jiaqi Li, Zhipeng Lou, Stefan Richter, and Wei Biao Wu

Reference 9

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.141985Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.000670Z digest=sha256:5c330249f0266dd2b360f8e68864b33703171d59864cd756c47ec22127976f57

Observation bdb5e155-f804-486f-9836-8a439edd6fa3 · outbound

This paper cites Xiaofeng Shao.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Xiaofeng Shao

Reference 13

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.098203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.020736Z digest=sha256:faca524e27fecba8556b875b6cbddc36a73d46a8a14940be62da05c4fc9a5b79

Observation 955976bc-12f1-486c-b316-fc23c4c954f0 · outbound

This paper cites Richard S.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Richard S

Reference 1988

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.029905Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.029905Z digest=sha256:541a77d7a862fd1f67feaec2dbd94cb81e595c121ca9fac251d6fbe6a8ddf665

Observation ea3a4699-b3e5-43cd-ab3d-30812a2c56cb · outbound

This paper cites Statistical Inference for Policy Evaluation with Temporal Difference Learning.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Statistical Inference for Policy Evaluation with Temporal Difference Learning

Reference 1997

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.035055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.035055Z digest=sha256:caaafabefce890c2d7db487a23e64799cd523dd44f964e706af95cd409718810

Observation 87b0be82-5ab1-4d66-8504-42f543c2aeb0 · outbound

This paper cites Caio Kalil Lauand and Sean Meyn.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Caio Kalil Lauand and Sean Meyn

Reference 2000

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.491749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.985570Z digest=sha256:4970e91d5e8d23165cd84b94a4172652db0d0179263576fdc043ae6cbdd3c64f

Observation e4b06e77-82b8-4948-818e-4b44f093d559 · outbound

This paper cites an unresolved cited work.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Unresolved cited work

Reference 2010

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.025201Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.025201Z digest=sha256:0ae781dd507299e852cd44c22668177c8ee5d50dab43196a3fccb434c98d2fec

Observation 232658bc-aed1-4d42-80f9-f2d73a2a825c · outbound

This paper cites Wenlong Mou, Ashwin Pananjady, Martin J.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Wenlong Mou, Ashwin Pananjady, Martin J

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T14:57:07.698778Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.015998Z digest=sha256:49755d4513d358cb3b32d3f1fcf1306c78492b825ff68222393d2ed4af848080

Observation 9ba6c88b-c72f-43f7-9c76-3a8444d83c47 · outbound

This paper cites Christoph Dann, Gerhard Neumann, and Jan Peters.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Christoph Dann, Gerhard Neumann, and Jan Peters

Reference 2021

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.680106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.965178Z digest=sha256:1489c6035ad50667c1e50a9c58ebaec02148dec97d07596ed389e28c8db8e26e

Observation a7858fae-28e9-456b-811d-a2b403898e4f · outbound

This paper cites 27 Ilya Levin, Alexey Naumov, and Sergey Samsonov.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling 27 Ilya Levin, Alexey Naumov, and Sergey Samsonov

Reference 2022

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.158083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.995218Z digest=sha256:b81586aca3460426d5fafdd01399713280d727728027d73176dcb8d986e2b243

Observation 69bdd250-4eaf-4ef0-ab1c-b8eb66c2af0f · outbound

This paper cites an unresolved cited work.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Unresolved cited work

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.011078Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.011078Z digest=sha256:a6f9ade7a933918035fcc626fc35b120163f7123cacbdf81d452a1e110a70b0c

Observation 2fcb3fa3-f75e-42e9-b8a7-f309e255f8ac · outbound

This paper cites Jalaj Bhandari, Daniel Russo, and Raghav Singal.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Jalaj Bhandari, Daniel Russo, and Raghav Singal

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:06.959519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:06.959519Z digest=sha256:ab3eeaf7baaf255e9aa29f7392541b97d46ccaed19ca512556a7626b3216628f

Observation 3c81c8c1-c13e-4798-b8da-da44192d1440 · outbound

This paper cites Xiang Li, Jiadong Liang, and Zhihua Zhang.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Xiang Li, Jiadong Liang, and Zhihua Zhang

Reference 2025

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.125766Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.005525Z digest=sha256:a7c4549092f8ea40714375242b30d3b9f931bb75d4c13c0de2b8f39b504ff927

Observation 04c79041-1e76-4d2c-9327-089a6e3e5a45 · outbound

This paper cites Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise

Reference 2026

Resolution
metadata mismatch
local_arxiv, observed 2026-08-12T14:57:07.212828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.970199Z digest=sha256:6bf3b1fb87105b7a76c4fd9bf56e58dda2bdc7abbaa95c97a2e7af653dfc140f

Pith citing papers

No inbound Pith citation observations are available.