Pith. sign in

Paper Citation Record · LEDGER

Learning Non-Markovian Reward Models in MDPs

As of 22 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 3 inbound Pith citation observations for arXiv:2001.09293.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2001.09293 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 3 of 3 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T17:37:34.388699Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-19T01:06:57.329776Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 93124684-39be-43f0-a505-9e378793009e · inbound

Constructing Non-Markovian Decision Process via History Aggregator cites this paper.

Constructing Non-Markovian Decision Process via History Aggregator Learning Non-Markovian Reward Models in MDPs

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T21:45:13.232447Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T21:45:13.232447Z digest=sha256:2f4f754bbf572c52162c254f3255fae05eaa9999d46507130839cc33e2ce0d04

Observation bb400c18-1696-4b34-a215-7b75a0d2ed32 · inbound

Synthetic POMDPs to Challenge Memory-Augmented RL: Memory Demand Structure Modeling cites this paper.

Synthetic POMDPs to Challenge Memory-Augmented RL: Memory Demand Structure Modeling Learning Non-Markovian Reward Models in MDPs

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-05-19T01:06:57.334946Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-05-19T01:06:07.789346Z digest=sha256:f96b4fc2b517d22f866802fa11f1777105fe08555b67a4a7c3e089ef8fef4430

Observation 6148e142-cc46-4273-b43c-dc9cb513a1cc · inbound

Physics-Informed Reward Machines cites this paper.

Physics-Informed Reward Machines Learning Non-Markovian Reward Models in MDPs

Reference 2019

Resolution
unresolved
no resolver link, observed 2026-08-15T17:37:34.388699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:37:34.388699Z digest=sha256:647c4aa3cfa0b21bef9eb273cacaa8c5f99a4e63118801d0cca3543e702b9458