Pith. sign in

Paper Citation Record · LEDGER

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling

As of 18 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 0 inbound Pith citation observations for arXiv:2608.10896.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.10896 v1

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T14:57:07.035055Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

16 of 16 outbound references displayed

  • verified exact8
  • verified fuzzy1
  • unresolved6
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 379b6935-8a79-4e3d-9c95-ff6926e2547e · outbound

This paper cites Dongyan Lucy Huo, Yudong Chen, and Qiaomin Xie.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Dongyan Lucy Huo, Yudong Chen, and Qiaomin Xie

Reference 4

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.188883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.975599Z digest=sha256:7a43ad2858ba7ec383d18f767a73f59898a0105fe29e98cccf752c51dcda5657

Observation b5cc44d7-cb48-4990-9911-58a6dd0f70da · outbound

This paper cites Nicholas M.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Nicholas M

Reference 5

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.576569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.980865Z digest=sha256:1e962f76f316d21c7d2397b0757a772abad6d256ff265b29dbc61b8ec78c31df

Observation 36064249-498c-46dc-a493-c2c15296e0e9 · outbound

This paper cites Revisiting Step-Size Assumptions in Stochastic Approximation.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Revisiting Step-Size Assumptions in Stochastic Approximation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:06.990142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:06.990142Z digest=sha256:76fe4bd06a031d0d7493d9eb047589fc9f4de7bd3de026fc648f9a238f663c34

Observation 732ac268-c36f-4e81-80b6-410211f11ab2 · outbound

This paper cites Jiaqi Li, Zhipeng Lou, Stefan Richter, and Wei Biao Wu.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Jiaqi Li, Zhipeng Lou, Stefan Richter, and Wei Biao Wu

Reference 9

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.141985Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.000670Z digest=sha256:cfb1ff3a1c3dd1c20eb43214f44c5e4d911d992fbfdd825be653cb1861711b8f

Observation bdb5e155-f804-486f-9836-8a439edd6fa3 · outbound

This paper cites Xiaofeng Shao.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Xiaofeng Shao

Reference 13

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.098203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.020736Z digest=sha256:1ac12d7d1921e3fd84bb2d38ff818a78b4e26fe89c1471d6129bcea6f93e9b23

Observation 955976bc-12f1-486c-b316-fc23c4c954f0 · outbound

This paper cites Richard S.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Richard S

Reference 1988

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.029905Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.029905Z digest=sha256:adde65c48cf452da9bb17f39fea6c61dd9d93f191d8ffb82ddf979bd667f1001

Observation ea3a4699-b3e5-43cd-ab3d-30812a2c56cb · outbound

This paper cites Statistical Inference for Policy Evaluation with Temporal Difference Learning.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Statistical Inference for Policy Evaluation with Temporal Difference Learning

Reference 1997

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.035055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.035055Z digest=sha256:0ff3e6a39808519cb90dfbb6b62a16abcd066dcda8942b280f6fd734d50f5451

Observation 87b0be82-5ab1-4d66-8504-42f543c2aeb0 · outbound

This paper cites Caio Kalil Lauand and Sean Meyn.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Caio Kalil Lauand and Sean Meyn

Reference 2000

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.491749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.985570Z digest=sha256:b62a9b0a2cb5348751b4bc980d27875fabcd1e2f108b35e42af0b65713e57228

Observation e4b06e77-82b8-4948-818e-4b44f093d559 · outbound

This paper cites an unresolved cited work.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Unresolved cited work

Reference 2010

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.025201Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.025201Z digest=sha256:768c88853c17ca36d2e70927889505b8b1e33dbb1dd024566c174c12f8271af8

Observation 232658bc-aed1-4d42-80f9-f2d73a2a825c · outbound

This paper cites Wenlong Mou, Ashwin Pananjady, Martin J.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Wenlong Mou, Ashwin Pananjady, Martin J

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T14:57:07.698778Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.015998Z digest=sha256:c9077657ed551d60f5c6b3452ae4da127b5a1f1939153b9c087af2f95d7e0b55

Observation 9ba6c88b-c72f-43f7-9c76-3a8444d83c47 · outbound

This paper cites Christoph Dann, Gerhard Neumann, and Jan Peters.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Christoph Dann, Gerhard Neumann, and Jan Peters

Reference 2021

Resolution
verified exact
raw_fallback, observed 2026-08-12T14:57:07.680106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.965178Z digest=sha256:1fd0054b7efd6b758811209fabb03ea594a487097198138a9e0c3fbc743f9d38

Observation a7858fae-28e9-456b-811d-a2b403898e4f · outbound

This paper cites 27 Ilya Levin, Alexey Naumov, and Sergey Samsonov.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling 27 Ilya Levin, Alexey Naumov, and Sergey Samsonov

Reference 2022

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.158083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.995218Z digest=sha256:4101cdeedd8a23fa7e2a8b1ec998068523c0c688979eeed25da7ab4021d8f1be

Observation 69bdd250-4eaf-4ef0-ab1c-b8eb66c2af0f · outbound

This paper cites an unresolved cited work.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Unresolved cited work

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:07.011078Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:07.011078Z digest=sha256:2d6eba36b73b447c46aa7961126c4c1e851f0d034bf9a8981f216ef2ddde57a8

Observation 2fcb3fa3-f75e-42e9-b8a7-f309e255f8ac · outbound

This paper cites Jalaj Bhandari, Daniel Russo, and Raghav Singal.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Jalaj Bhandari, Daniel Russo, and Raghav Singal

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-12T14:57:06.959519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:57:06.959519Z digest=sha256:ed42ea0378ffd60aba22c23517bb8972d780286815c8e832529aa4024ddef893

Observation 3c81c8c1-c13e-4798-b8da-da44192d1440 · outbound

This paper cites Xiang Li, Jiadong Liang, and Zhihua Zhang.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Xiang Li, Jiadong Liang, and Zhihua Zhang

Reference 2025

Resolution
verified exact
doi, observed 2026-08-12T14:57:07.125766Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:07.005525Z digest=sha256:564626d4c3da4a752ca1af798b712fcc757e916220d587a8f0765ed220537aea

Observation 04c79041-1e76-4d2c-9327-089a6e3e5a45 · outbound

This paper cites Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise.

Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise

Reference 2026

Resolution
metadata mismatch
local_arxiv, observed 2026-08-12T14:57:07.212828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-12T14:57:06.970199Z digest=sha256:4f73575defb7df103f08c9903f30194d0c11d79473efe59ce067169fbb036eec

Pith citing papers

No inbound Pith citation observations are available.