Pith. sign in

Paper Citation Record · LEDGER

Online MDP with Transition Prototypes: A Robust Adaptive Approach

As of 11 August 2026, this Paper Citation Record lists 34 of 34 outbound references and 0 inbound Pith citation observations for arXiv:2412.14075.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.14075 v2

Coverage vector

measured 34 of 34 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T12:38:32.547517Z

measured 34 of 34 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

34 of 34 outbound references displayed

  • verified exact1
  • verified fuzzy6
  • unresolved27
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e0a3b406-91a4-4010-80a5-017d598ef475 · outbound

This paper cites , " * write output.state after.block = add.period write newline.

Online MDP with Transition Prototypes: A Robust Adaptive Approach , " * write output.state after.block = add.period write newline

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.177430Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.177430Z digest=sha256:fdfc3217a8092fcd68856e9a1e9174241358b448b90192a1a1173fc08b7f14b9

Observation b4ab0349-ebcb-43ac-8b4b-173825fc2070 · outbound

This paper cites write newline.

Online MDP with Transition Prototypes: A Robust Adaptive Approach write newline

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.181342Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.181342Z digest=sha256:3a98745f1b18e3dd2d86b3cbbd74ec0d1ac5e1bad348a65c6390a7af1609f2b2

Observation 677c2e43-bf96-461f-a037-dca6b1b2a0a3 · outbound

This paper cites Posterior sampling for reinforcement learning: worst-case regret bounds.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Posterior sampling for reinforcement learning: worst-case regret bounds

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.184591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.184591Z digest=sha256:e3afe856bca2d6b688953ccd2e859b6e6ee0ec782dd039f14d2c9aec1fd8ae6b

Observation 037280dc-bb8e-4873-81b7-de4b190ff471 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.578891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.210663Z digest=sha256:27ef6b56000e893ad9a5f08398d20540588e121749364b527873dfbbe8375bc1

Observation bc9ba930-a624-4c2d-9261-234207da20af · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.569572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.231337Z digest=sha256:46300db3489092da88f736a6a7e887ed239f8a175d8cbf6a8276ed05b7f353f3

Observation d3958e1c-5157-4154-8b1e-ab77d4e23ff3 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.562354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.264920Z digest=sha256:cbd5951c6f2c02386ce107a43628f94a0c53c68bcf3806975e872e69b46b4f25

Observation 7410b042-2005-4c0f-940a-8f612010b704 · outbound

This paper cites G.; Osband, I.; and Munos, R.

Online MDP with Transition Prototypes: A Robust Adaptive Approach G.; Osband, I.; and Munos, R

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.551577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.307993Z digest=sha256:c4694afb486086f4885ecc1967afd403c3e75e71ad88ae0d8a85781a7289f67c

Observation d678adb4-74be-4631-971c-f25b8bfa62c4 · outbound

This paper cites I.; and Tennenholtz, M.

Online MDP with Transition Prototypes: A Robust Adaptive Approach I.; and Tennenholtz, M

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.480385Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.337737Z digest=sha256:de187cf0fa1218419fba74bff86e05b05363e7ee54dd8adce4409d7232ffd8d1

Observation 2c3c9e62-1966-4389-9276-4c57411a7732 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.400034Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.341947Z digest=sha256:18d711565b3821352d42aa5c75db56fb01d1cd5ca4baf9b67a00eb9a6ff0a8a3

Observation a193c38e-6841-449f-93cf-7455dba7cc06 · outbound

This paper cites N.; and Katehakis, M.

Online MDP with Transition Prototypes: A Robust Adaptive Approach N.; and Katehakis, M

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.391818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.346166Z digest=sha256:067997d5f0593e7eba465352571fc352b7572ff10af1970bb99da00e515dcb8c

Observation a6548d5e-c9b8-473b-91b3-fd8f1fb2fbe7 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.382850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.349466Z digest=sha256:ff085015905c6077691b46fb5b4d6437bd7c663ded8aac8e8ce6ac791bf46c9b

Observation 6003e351-69bc-4111-857d-6e288234c082 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.373117Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.352453Z digest=sha256:7fd66f1a4cb90e675257e343835d6796fb1613948a2c8156025045c1c906a571

Observation 66cf95d7-7694-4784-9c60-4feb38bc9caa · outbound

This paper cites D.; Flet-Berliac, Y.; Leurent, E.; M \'e nard, P.; Shang, X.; and Valko, M.

Online MDP with Transition Prototypes: A Robust Adaptive Approach D.; Flet-Berliac, Y.; Leurent, E.; M \'e nard, P.; Shang, X.; and Valko, M

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:33.262246Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.354833Z digest=sha256:5f29fabc1b2b538d33559217a3a58fd3adb13ee3f1e75ab7ee09eb21280a3139

Observation 1265e59e-ad52-4a2b-bafd-c2597f2df802 · outbound

This paper cites Online Policy Optimization for Robust MDP.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Online Policy Optimization for Robust MDP

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.357303Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.357303Z digest=sha256:35e017a21b2006bb23bf32ec9fb7f67ea37443ac213da4f8a73bbdb6f010091c

Observation 3f15464c-6930-4839-8de2-7b938e8076d3 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.207727Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.360052Z digest=sha256:1baf5e8164a39a4a982d473b8b5978969b0062a42b8019ec83e94277796b37c1

Observation 13b1f371-91f3-451c-9e35-c69ac6119d0b · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.201079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.361825Z digest=sha256:f9a0e04997533446c56b2893d3b6d84cc4cc0e5d26f6a459fbf9ba8b6b270c4c

Observation 0f7c8835-03bd-49ba-8a04-4e6845a0e5ae · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.193355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.364975Z digest=sha256:c8e93b9f433e62d1c634563f7f3d8f6e7cbc0b25b20f2c2f832fa510119c4543

Observation 1bfe326c-fd1f-425e-85d6-38b352734998 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.185288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.367438Z digest=sha256:9be8087665cde21debb1355353fc1d6930a614c7f9e661d62ca4e05f1e4c03f1

Observation d3974b50-b389-414f-b345-5676e78927e2 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.177404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.370936Z digest=sha256:09e0ed25216e044eb5cd6b55bc454ecfb3bf4ca4e46d728ae1890955a51110c8

Observation 198201cd-6297-4bad-8bb8-42c911afe3fb · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.168006Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.374851Z digest=sha256:e32956d7dd60b59476c90e2a1771e1afcd492621689eab0b784ab6214f51ba09

Observation 4cc9059a-fe6a-40d2-9dcb-14b124dea950 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.159200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.378901Z digest=sha256:cd8efe001517f53b1013ce63cd6533f362c8529223bae72469bb29d0f6aff969

Observation e408df9f-0881-4694-aafe-0c6e403e2991 · outbound

This paper cites Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-11T12:38:32.381723Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T12:38:32.381723Z digest=sha256:02c7690b5813fa9f92e1aea06cb18d75bfbb033d7e13630ec00ce70741fa9397

Observation d0206700-54d2-4579-a91f-fde410ad2e4d · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:33.048004Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.384656Z digest=sha256:1b0c2929a62a737454f023bbd9be638ddb1e5bdf3c07a43e32950da0325f17e0

Observation d4ca4da6-e7ca-42fb-bdd9-34e33859124c · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.966458Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.387393Z digest=sha256:cedf854b12c94f444f49617acc5701339ff3a0f745cd467c7b9646114b1989eb

Observation 8b2bb797-1cd4-4506-8264-e72073d7d253 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.958239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.389729Z digest=sha256:cdcd039a7459f378784362b796cbe6210ae738bb7580947ebee14934a2ec39fb

Observation e2f314c2-b3e6-4fd8-bb18-b3b093901f03 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.949663Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.392862Z digest=sha256:9b45fb8019461c80b0010d1023f594742e5965e3377f122a1bf58e52842e280d

Observation 8dd2d685-6844-4202-b19e-18ac66c22e14 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.942038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.396121Z digest=sha256:f635a7d060bc82c5f78e2060c8a8614dd6445ad384e1e4ec544c02a918e8cae0

Observation c1e3b2fd-f81b-49ad-a439-91e438ce7ef1 · outbound

This paper cites Robust Batch Policy Learning in Markov Decision Processes.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Robust Batch Policy Learning in Markov Decision Processes

Reference 28

Resolution
verified exact
local_arxiv, observed 2026-08-11T12:38:32.576180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.422165Z digest=sha256:8b3c78c52e3ecd235a99cf63482db02572e5dce4f78dbe2961bbb0cfa7c14142

Observation 59df1397-6958-4e95-a1e1-021205c121e1 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.933065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.455219Z digest=sha256:c0ee367b02c3f19fc156da9f47cae0288daeff3a0b413bd5d70ac6cc9c3eb60c

Observation ba279a8b-f8fe-4197-a324-3a48397ed5e0 · outbound

This paper cites N.; Kaufman, D.

Online MDP with Transition Prototypes: A Robust Adaptive Approach N.; Kaufman, D

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:32.922750Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.501607Z digest=sha256:da05ba5c1ab34712f676f9a427cefe99cfba3253498dcec860b6a9673c5fe196

Observation 97578bd9-0214-47a3-ad69-54db7188d89e · outbound

This paper cites S.; and Barto, A.

Online MDP with Transition Prototypes: A Robust Adaptive Approach S.; and Barto, A

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:38:32.815824Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.539424Z digest=sha256:50854224b8a6c20997ea13e4ba15754a4dbd2dba78cc3a67d43ba1042248de8b

Observation d161bee1-bc1d-49f3-80b9-d4ee7f7be4a1 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.651105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.542468Z digest=sha256:3d10dd84b93119362553aadae9a3fa83b03f51d7a577612d43071474e869d3f7

Observation 646fe793-e686-4806-8ca2-7766f23bc5fd · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 33

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.615708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.545393Z digest=sha256:3f8b03084082a86bc95e3e92bb6f3c435459c5ea26819627ebea7d5ed3165193

Observation f1dcd06a-da8a-489f-97de-32b0c51af4d0 · outbound

This paper cites an unresolved cited work.

Online MDP with Transition Prototypes: A Robust Adaptive Approach Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:38:32.606492Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-08-11T12:38:32.547517Z digest=sha256:528f2c9e717f80e5f3bd84cd04c95e0d7c091c7de9c1ac06c26d68204e64691f

Pith citing papers

No inbound Pith citation observations are available.