Paper Citation Record · LEDGER

Contextual Markov Decision Processes

As of 22 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 39 inbound Pith citation observations for arXiv:1502.02259.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
1502.02259 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 39 of 39 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 39 of 39 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T12:18:48.505040Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

73
pith, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation b56488e7-2e14-4a2b-a26e-35431ad280ba · inbound

AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers cites this paper.

AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers Contextual Markov Decision Processes

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-12T18:52:13.891027Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f844fa9a-4d18-4725-a325-16baacc6b3f8 · inbound

A Bayesian Composite Risk Approach for Stochastic Optimal Control and Markov Decision Processes cites this paper.

A Bayesian Composite Risk Approach for Stochastic Optimal Control and Markov Decision Processes Contextual Markov Decision Processes

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-11T10:38:29.484844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f53f9fad-1c1f-4c8f-83fd-48e3c6706a04 · inbound

Single-Agent Planning in a Multi-Agent System: A Unified Framework for Type-Based Planners cites this paper.

Single-Agent Planning in a Multi-Agent System: A Unified Framework for Type-Based Planners Contextual Markov Decision Processes

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-07T23:14:16.405870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 72cc724b-ec18-4e01-8074-87fae4431a62 · inbound

Exploring Expert Failures Improves LLM Agent Tuning cites this paper.

Exploring Expert Failures Improves LLM Agent Tuning Contextual Markov Decision Processes

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-16T12:18:48.505040Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5f691eff-8ab2-4dd1-a104-588dbecf0747 · inbound

Return Capping: Sample-Efficient CVaR Policy Gradient Optimisation cites this paper.

Return Capping: Sample-Efficient CVaR Policy Gradient Optimisation Contextual Markov Decision Processes

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-16T05:24:51.723782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b40c071f-e38a-40fb-9726-53d625e62f7b · inbound

Efficient Sensorimotor Learning for Open-world Robot Manipulation cites this paper.

Efficient Sensorimotor Learning for Open-world Robot Manipulation Contextual Markov Decision Processes

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-15T23:27:51.336226Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f9da9b5a-bfce-4892-8712-5ec7eb15e623 · inbound

Distilling Realizable Students from Unrealizable Teachers cites this paper.

Distilling Realizable Students from Unrealizable Teachers Contextual Markov Decision Processes

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T21:36:14.441636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c9830bbe-fec2-4f4d-9b28-3432eb83671c · inbound

Pessimism Principle Can Be Effective: Towards a Framework for Zero-Shot Transfer Reinforcement Learning cites this paper.

Pessimism Principle Can Be Effective: Towards a Framework for Zero-Shot Transfer Reinforcement Learning Contextual Markov Decision Processes

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-07T14:37:24.352549Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9135ebbd-6a7a-4ac0-89ff-ded3ac6cd182 · inbound

Learning What Matters Now: A Dual-Critic Context-Aware RL Framework for Priority-Driven Information Gain cites this paper.

Learning What Matters Now: A Dual-Critic Context-Aware RL Framework for Priority-Driven Information Gain Contextual Markov Decision Processes

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T05:55:08.137170Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6fd87cd9-d368-412c-91a5-d11b5b3359a0 · inbound

CARoL: Context-aware Adaptation for Robot Learning cites this paper.

CARoL: Context-aware Adaptation for Robot Learning Contextual Markov Decision Processes

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-07T05:49:54.794251Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 27db7a0c-8fac-4691-a8cb-ebd12f9156e4 · inbound

Causal-Paced Deep Reinforcement Learning cites this paper.

Causal-Paced Deep Reinforcement Learning Contextual Markov Decision Processes

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-15T18:28:00.127323Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f93eae9-4c6e-424d-8d19-94ed9ca89dbc · inbound

Multi-residual Mixture of Experts Learning for Cooperative Control in Multi-vehicle Systems cites this paper.

Multi-residual Mixture of Experts Learning for Cooperative Control in Multi-vehicle Systems Contextual Markov Decision Processes

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T17:52:17.254533Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6ebcc287-be0f-44a4-ab75-e18fc9934948 · inbound

Observations Meet Actions: Learning Control-Sufficient Representations for Robust Policy Generalization cites this paper.

Observations Meet Actions: Learning Control-Sufficient Representations for Robust Policy Generalization Contextual Markov Decision Processes

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-15T18:02:17.792608Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3c292955-ea99-439a-95b3-0c2b5149435a · inbound

cMALC-D: Contextual Multi-Agent LLM-Guided Curriculum Learning with Diversity-Based Context Blending cites this paper.

cMALC-D: Contextual Multi-Agent LLM-Guided Curriculum Learning with Diversity-Based Context Blending Contextual Markov Decision Processes

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-05T14:49:53.177817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bebb2af2-13c7-4be7-9c1c-06c3f36edaa9 · inbound

Fully Decentralized Cooperative Multi-Agent Reinforcement Learning is A Context Modeling Problem cites this paper.

Fully Decentralized Cooperative Multi-Agent Reinforcement Learning is A Context Modeling Problem Contextual Markov Decision Processes

Reference 6

Resolution: verified exact; local_arxiv, observed 2026-05-18T15:16:32.275063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 968dbc45-c53f-422e-8155-d864e6aebeaa · inbound

Stability Analysis of an Integrated Multistage Stochastic Programming and Markov Decision Process Problem cites this paper.

Stability Analysis of an Integrated Multistage Stochastic Programming and Markov Decision Process Problem Contextual Markov Decision Processes

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-15T15:52:07.806151Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f04a17ec-47f7-44d3-93a4-f39f6f8a7a79 · inbound

MDP modeling for multi-stage stochastic programs cites this paper.

MDP modeling for multi-stage stochastic programs Contextual Markov Decision Processes

Reference 24

Resolution: metadata mismatch; local_arxiv, observed 2026-05-18T12:51:23.232545Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation cda049b6-34f6-4bc1-9e1d-d28c1077984b · inbound

Can Context Bridge the Reality Gap? Sim-to-Real Transfer of Context-Aware Policies cites this paper.

Can Context Bridge the Reality Gap? Sim-to-Real Transfer of Context-Aware Policies Contextual Markov Decision Processes

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-03T23:47:19.304947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ffad2f79-4bf0-4ca9-b291-bf2f46578559 · inbound

Adaptive Exploration for Latent-State Bandits cites this paper.

Adaptive Exploration for Latent-State Bandits Contextual Markov Decision Processes

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-03T04:23:37.152692Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation de66711d-3d1d-4196-a7cb-7a50aa09c23d · inbound

Pushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic Optimization cites this paper.

Pushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic Optimization Contextual Markov Decision Processes

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-03T00:13:25.745024Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 929749af-db8f-47fe-bd46-3cb3d04be5ae · inbound

Stochastic Optimal Control with Side Information and Bayesian Learning cites this paper.

Stochastic Optimal Control with Side Information and Bayesian Learning Contextual Markov Decision Processes

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-02T20:55:10.535406Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17f8a0ac-58aa-4af8-a0a6-04ee9fdfff38 · inbound

Contextual Intelligence The Next Leap for Reinforcement Learning cites this paper.

Contextual Intelligence The Next Leap for Reinforcement Learning Contextual Markov Decision Processes

Reference 30

Resolution: verified exact; local_arxiv, observed 2026-05-15T21:56:40.746301Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation fe3700d4-5fd1-4216-b582-a2070def3ee3 · inbound

Behavior-Constrained Reinforcement Learning with Receding-Horizon Credit Assignment for High-Performance Control cites this paper.

Behavior-Constrained Reinforcement Learning with Receding-Horizon Credit Assignment for High-Performance Control Contextual Markov Decision Processes

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-05-13T19:33:09.995447Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 5bd9671b-f2fc-4716-aa31-4fa7e3db2fd5 · inbound

Contextual Multi-Task Reinforcement Learning for Autonomous Reef Monitoring cites this paper.

Contextual Multi-Task Reinforcement Learning for Autonomous Reef Monitoring Contextual Markov Decision Processes

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-05-10T15:15:31.412840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 8d0b6b86-1d15-4101-a783-e0fbc184be40 · inbound

Contextual Multi-Task Reinforcement Learning for Autonomous Reef Monitoring cites this paper.

Contextual Multi-Task Reinforcement Learning for Autonomous Reef Monitoring Contextual Markov Decision Processes

Reference 13

Resolution: unresolved; no resolver link, observed 2026-07-12T21:15:13.179473Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d6a44c3-cd03-44ad-81e9-f05670e92287 · inbound

Task-specific Subnetwork Discovery in Reinforcement Learning for Autonomous Underwater Navigation cites this paper.

Task-specific Subnetwork Discovery in Reinforcement Learning for Autonomous Underwater Navigation Contextual Markov Decision Processes

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-05-09T22:54:15.946633Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 3e0cf124-39af-4f8f-879d-8549cf64ef73 · inbound

Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making cites this paper.

Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making Contextual Markov Decision Processes

Reference 299

Resolution: verified exact; local_arxiv, observed 2026-05-20T20:59:02.051159Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f5f99cec-176a-4e89-8772-ecf0bcf45aad · inbound

MATE: Solving Contextual Markov Decision Processes with Memory of Accumulated Transition Embeddings cites this paper.

MATE: Solving Contextual Markov Decision Processes with Memory of Accumulated Transition Embeddings Contextual Markov Decision Processes

Reference 4

Resolution: metadata mismatch; local_arxiv, observed 2026-05-20T13:43:19.576701Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 511066f1-1bb7-4a40-ae15-a5283ce7f961 · inbound

Curriculum reinforcement learning with measurable task representation learning cites this paper.

Curriculum reinforcement learning with measurable task representation learning Contextual Markov Decision Processes

Reference 22

Resolution: verified exact; local_arxiv, observed 2026-05-25T05:20:24.535340Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 04b20f8f-11eb-42ad-8ef0-a119cd211112 · inbound

Functional Cache Grafting: Robust and Rapid Code-Policy Synthesis for Embodied Agents cites this paper.

Functional Cache Grafting: Robust and Rapid Code-Policy Synthesis for Embodied Agents Contextual Markov Decision Processes

Reference 8

Resolution: verified exact; local_arxiv, observed 2026-06-27T05:30:35.807934Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 558219e2-4109-498d-9f5c-b5eb5e9370b5 · inbound

Functional Cache Grafting: Robust and Rapid Code-Policy Synthesis for Embodied Agents cites this paper.

Functional Cache Grafting: Robust and Rapid Code-Policy Synthesis for Embodied Agents Contextual Markov Decision Processes

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-02T11:44:03.326034Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d9d14578-a889-4056-9bec-fe5bd13eb311 · inbound

Formalizing Task-Space Complexity for Zero-Shot Generalization cites this paper.

Formalizing Task-Space Complexity for Zero-Shot Generalization Contextual Markov Decision Processes

Reference 13

Resolution: metadata mismatch; local_arxiv, observed 2026-07-04T03:59:32.897286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ca968e47-7a2e-4a89-8d72-4104e5d95c82 · inbound

Deep Reinforcement Learning for Spacecraft Attitude Control During Atmospheric Re-Entry cites this paper.

Deep Reinforcement Learning for Spacecraft Attitude Control During Atmospheric Re-Entry Contextual Markov Decision Processes

Reference 16

Resolution: verified exact; local_arxiv, observed 2026-07-01T09:45:40.133089Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation dda56ac2-96ae-4e1a-b77d-248cb3d5ba3c · inbound

Generalization in offline RL: The structure is more important than the amount of pessimism cites this paper.

Generalization in offline RL: The structure is more important than the amount of pessimism Contextual Markov Decision Processes

Reference 14

Resolution: verified exact; local_arxiv, observed 2026-07-03T16:48:39.613163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 8ee5bdc7-250c-426a-a955-1803240f2468 · inbound

Generalization in offline RL: The structure is more important than the amount of pessimism cites this paper.

Generalization in offline RL: The structure is more important than the amount of pessimism Contextual Markov Decision Processes

Reference 14

Resolution: unresolved; no resolver link, observed 2026-07-12T08:14:49.235476Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e68cc24d-7246-46b4-a538-8b934a8ac63d · inbound

DishSeg24k: A Large-Scale Benchmark for Food Segmentation with Stochastic Expert Decoding cites this paper.

DishSeg24k: A Large-Scale Benchmark for Food Segmentation with Stochastic Expert Decoding Contextual Markov Decision Processes

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-01T03:45:07.792047Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aebbd072-3b0a-4c72-8560-1f69e7115182 · inbound

Partner Capability Estimation for Task-Agnostic Adaptation in Ad-Hoc Teamwork cites this paper.

Partner Capability Estimation for Task-Agnostic Adaptation in Ad-Hoc Teamwork Contextual Markov Decision Processes

Reference 54

Resolution: unresolved; no resolver link, observed 2026-07-30T10:55:47.357867Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be37c9fe-bd9a-47d6-945b-0f92d79d92ee · inbound

World Action Planner: Generalizable Decision-Making with Action-Conditioned World Models cites this paper.

World Action Planner: Generalizable Decision-Making with Action-Conditioned World Models Contextual Markov Decision Processes

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-01T04:59:31.388229Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 025f486c-9489-4f35-8e56-6aea85894ebf · inbound

A Distribution Mapping Approach to Counterfactually Fair Reinforcement Learning cites this paper.

A Distribution Mapping Approach to Counterfactually Fair Reinforcement Learning Contextual Markov Decision Processes

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:28.076578Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.