On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments | Paper Citation Record

Observation 3f93eeb3-4e99-4be4-953c-f6d0e9845569 · outbound

This paper cites (1965) Optimal control of partially observable Markovian systems.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1965) Optimal control of partially observable Markovian systems

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T10:39:45.026149Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 76605c26-4b23-4857-a3ef-ababd265208b · outbound

This paper cites (1993) Discrete time controlled Markov processes with average cost criterion: a survey, SIAM J.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1993) Discrete time controlled Markov processes with average cost criterion: a survey, SIAM J

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T10:39:45.082420Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 055045ce-7bc2-47d6-9d23-6a1bff546a3f · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T10:39:45.136334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 645eab42-e350-401b-95c0-9cc08639c7a1 · outbound

This paper cites (1964) Mixed and behavior strategies in infinite exstensive games.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1964) Mixed and behavior strategies in infinite exstensive games

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-07T10:39:45.257510Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2317bed8-d38c-44c5-964a-eec69042a0b6 · outbound

This paper cites (1973) Optimal decision procedures for finite Markov chains.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1973) Optimal decision procedures for finite Markov chains

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.769864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation f47b5adc-0eb3-4699-9bf9-a7b16b048603 · outbound

This paper cites (1973) Optimal decision procedures for finite Markov chains.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1973) Optimal decision procedures for finite Markov chains

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.761372Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation e1c3317f-7204-4044-a640-f6edec68dce5 · outbound

This paper cites (1963) Topological Spaces.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1963) Topological Spaces

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.753084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation b04fccac-0737-4438-ba0e-fc277399faf7 · outbound

This paper cites (1996) Stochastic Optimal Control: The Discrete-Time Case.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1996) Stochastic Optimal Control: The Discrete-Time Case

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.743986Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 922fe413-d0e2-4510-9942-79570c7a5e9b · outbound

This paper cites (1996) Neuro-Dynamic Programming, Athena Scientific, Belmont, MA.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1996) Neuro-Dynamic Programming, Athena Scientific, Belmont, MA

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.735399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation b60f4712-37e2-41cb-a856-905ce7af5ad8 · outbound

This paper cites (1987) An expected average rward criterion.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1987) An expected average rward criterion

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.726645Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 8f72b53d-dfa0-4e8b-b44b-bbfbf9d20c0b · outbound

This paper cites (2014) Examples concerning Abel and Cesaro limits.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2014) Examples concerning Abel and Cesaro limits

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.718215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation fc77f84a-38fa-42b6-bf32-c156cdaf206a · outbound

This paper cites (1962) Discrete dynamic programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1962) Discrete dynamic programming

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.710114Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 522f3d0a-3495-4c6a-87f0-e5be369a3f6e · outbound

This paper cites (1965) Discounted dynamic programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1965) Discounted dynamic programming

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.701234Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation aea0f064-7763-47c8-bc2e-56c48fdd1e05 · outbound

This paper cites (1967) Positive dynamic programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1967) Positive dynamic programming

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.692308Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 993d8068-5ebe-4976-8bda-141b67df58f1 · outbound

This paper cites (1974) The optimal reward operator in dy- namic programming, Ann.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1974) The optimal reward operator in dy- namic programming, Ann

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.684076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 395331d8-515b-44f7-a5c0-432abfc6fcc5 · outbound

This paper cites (1991) A counterexample on the optimality equation in Markov deci- sion chains with the average cost criterion.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1991) A counterexample on the optimality equation in Markov deci- sion chains with the average cost criterion

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.675105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 8f04658e-b6a2-4b93-b474-5398715ccf2a · outbound

This paper cites (1975) A controlled finite Markov chain with an arbitrary set of decisions.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1975) A controlled finite Markov chain with an arbitrary set of decisions

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.665429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 051f3ad9-fc4d-4618-927b-474d44de4ca3 · outbound

This paper cites (1968) Multichain Markov renewal programs.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1968) Multichain Markov renewal programs

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.655744Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 4c43526c-b45a-45fd-bb3e-5886b5c7ecfb · outbound

This paper cites (1962) On sequential decisions and Markov chains.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1962) On sequential decisions and Markov chains

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.644754Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 40dda9d6-fdbc-41e3-b9fc-9db789e14a6b · outbound

This paper cites (1965) Controlled random sequences.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1965) Controlled random sequences

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.636377Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation dfa34d40-1aab-433f-a297-f88971636e29 · outbound

This paper cites (1979) Controlled Markov Processes.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1979) Controlled Markov Processes

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.627542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 28bc22c8-d21d-4ea8-8c4b-dc4b7946b791 · outbound

This paper cites (1980) SuccessivA survey of asymptotic value iteration for undiscounted Markov decision problems.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1980) SuccessivA survey of asymptotic value iteration for undiscounted Markov decision problems

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.619398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation b41b7488-bb5a-4ba1-a799-90c6d4ada47b · outbound

This paper cites (1975) On controlled finite state Markov processes with compact control sets, Theor.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1975) On controlled finite state Markov processes with compact control sets, Theor

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.610701Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 53c517e1-f4c9-4555-b9ff-6fae1fcafc18 · outbound

This paper cites (1978) The existence of a stationary ϵ-optimal policy for a finite Markov chain Theor.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1978) The existence of a stationary ϵ-optimal policy for a finite Markov chain Theor

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.601055Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 3e500274-1ca1-412a-89a1-198e65661359 · outbound

This paper cites (1980) An ϵ-optimal control of a finite Markov chain.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1980) An ϵ-optimal control of a finite Markov chain

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.592951Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 05f55253-978d-42dc-b327-9c1db210887d · outbound

This paper cites (1986) Sufficient classes of strategies in discrete dynamic programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1986) Sufficient classes of strategies in discrete dynamic programming

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.584305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 60e9a98b-49cb-4a45-b524-dc2505262928 · outbound

This paper cites (1987) Sufficient classes of strategies in discrete dynamic programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1987) Sufficient classes of strategies in discrete dynamic programming

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.576529Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 4f975af9-9a21-44a0-a91c-93daf8018658 · outbound

This paper cites (2020) Complexity bounds for approximately solving discounted MDPs by value iterations, Operations Research Letters 48(5): 545–548.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2020) Complexity bounds for approximately solving discounted MDPs by value iterations, Operations Research Letters 48(5): 545–548

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.566266Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 74676310-31e8-4d97-8127-ae159394d37b · outbound

This paper cites (2014) The value iteration algorithm is not strongly polynomial for discounted dynamic programming, Oper.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2014) The value iteration algorithm is not strongly polynomial for discounted dynamic programming, Oper

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.557081Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation ce139bc9-087f-49ec-a501-aa8043edac6f · outbound

This paper cites (2025) Continuity of filters for discrete-time control problems defined by explicit equations.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2025) Continuity of filters for discrete-time control problems defined by explicit equations

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.548135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation bec2b2bc-6d6d-42b2-a02d-c1eb5f2f66ea · outbound

This paper cites (2024) Sufficient conditions for solving statistical filtering problems by dynamic programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2024) Sufficient conditions for solving statistical filtering problems by dynamic programming

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.539926Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 3c7eb688-2221-40dc-b8ec-4f27fe401fa8 · outbound

This paper cites (2021) MDPs with setwise continuous transition probabil- ities.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2021) MDPs with setwise continuous transition probabil- ities

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.531271Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 3aa7b8ea-a03e-4656-a0dd-d2e0f7965f4d · outbound

This paper cites Voorneveld, M.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Voorneveld, M

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.523327Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 5cab61b7-37f4-4a0e-a41d-8a58e145c1c5 · outbound

This paper cites (2012) Average-cost Markov decision processes with weakly continuous transition probabilities, Math.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2012) Average-cost Markov decision processes with weakly continuous transition probabilities, Math

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.515448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation c24af95c-ed8d-42f0-8588-7da20e40d93b · outbound

This paper cites (2013) Berge’s theorem for noncompact image sets.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2013) Berge’s theorem for noncompact image sets

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.506473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 498e35e6-0c63-4258-805f-584e23575fa0 · outbound

This paper cites (2016) Partially observable total-cost Markov decision processes with weakly continuous transition probabilities.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2016) Partially observable total-cost Markov decision processes with weakly continuous transition probabilities

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.496515Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 93a7e02e-d12a-40b3-ac2f-babd2c45e174 · outbound

This paper cites (2022) Markov decision processes with incomplete information and semi-uniform Feller transition probabilities.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2022) Markov decision processes with incomplete information and semi-uniform Feller transition probabilities

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.487553Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation cd2ad5b9-6240-4ba8-a565-d18eef34ff32 · outbound

This paper cites (2023) Semi-uniform Feller stochastic kernels.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2023) Semi-uniform Feller stochastic kernels

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.478596Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 01d64d6f-812c-4682-bacf-a2666121678b · outbound

This paper cites (2008) On polynomial classification problems for Markov decision processes.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2008) On polynomial classification problems for Markov decision processes

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.470158Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 3822e12e-e2bf-4b0e-9694-f0884ea86329 · outbound

This paper cites (2014) On solutions of Kolmogorov’s equa- tions for jump Markov processes.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2014) On solutions of Kolmogorov’s equa- tions for jump Markov processes

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.462146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 798ea8c8-f7a1-4152-a6d0-b5f650d1fa21 · outbound

This paper cites (2022) Kolmogorov’s equations for jump Markov processes with unbounded jump rates.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2022) Kolmogorov’s equations for jump Markov processes with unbounded jump rates

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.454405Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 87bb2c1e-5e06-404d-8d38-3c397cfc750c · outbound

This paper cites (2022) Sufficiency of Markov policies for continuous-time jump Markov decision processes.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2022) Sufficiency of Markov policies for continuous-time jump Markov decision processes

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.446652Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 2aebd29e-f41f-4ecd-9962-5c3856799313 · outbound

This paper cites (2022) Kolmogorov’s equations for jump Markov processes and their applications to control problems.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2022) Kolmogorov’s equations for jump Markov processes and their applications to control problems

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.439495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 554ff18d-eb9b-425d-9f0a-a0128c2b8df1 · outbound

This paper cites (2024) On forward and backward Kolmogorov equations for pure jump Markov processes and their generalizations, Theor.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2024) On forward and backward Kolmogorov equations for pure jump Markov processes and their generalizations, Theor

Reference 44

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.432400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation dafeb665-37f4-4375-8632-2e599a616d4b · outbound

This paper cites (1983) Stationary and Markov policies in countable state dy- namic programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1983) Stationary and Markov policies in countable state dy- namic programming

Reference 45

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.425327Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 923c583d-1dd4-4cd3-a045-e8ed8aa68135 · outbound

This paper cites (1940) On the integro-differential equations of purely discontinuous Markoff processes, Trans.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1940) On the integro-differential equations of purely discontinuous Markoff processes, Trans

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.417240Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 004b2898-1e3a-4d21-b991-627a1127441b · outbound

This paper cites (1974) The optimal reward operator in special classes of dynamic program- ming problems, Ann.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1974) The optimal reward operator in special classes of dynamic program- ming problems, Ann

Reference 47

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.409875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation da30da9e-fd67-4d77-890f-9d0ac87be8aa · outbound

This paper cites (1979) Controlled Stochastic Processes.Springer, New York, NY.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1979) Controlled Stochastic Processes.Springer, New York, NY

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.402190Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation fc372a46-5dd9-45ff-a3df-07c14100d1d1 · outbound

This paper cites (2009)Continuous-Time Markov Decision Processes: The- ory and Applications.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2009)Continuous-Time Markov Decision Processes: The- ory and Applications

Reference 49

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.394929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 42945acd-ec97-4ac0-a61c-e868b89b4c04 · outbound

This paper cites (1989) Adaptive Markov Control Processes, Springer-Verlag, New York.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1989) Adaptive Markov Control Processes, Springer-Verlag, New York

Reference 50

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.388062Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 6f8ed756-1164-49ed-95b4-4a52d04f75fb · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 51

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:59.380430Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 7301501e-b1b7-427c-9b10-f093e36993df · outbound

This paper cites (1996)Discrete-Time Markov Control Processes: Ba- sic Optimality Criteria.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1996)Discrete-Time Markov Control Processes: Ba- sic Optimality Criteria

Reference 52

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.373503Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation c6295ff3-542f-4b49-a8c2-a7e10736234a · outbound

This paper cites (1960) Dynamic Programming and Markov Processes.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1960) Dynamic Programming and Markov Processes

Reference 53

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.366229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 62d405a4-61a8-41d3-9354-7c35b34cb493 · outbound

This paper cites (1983) Linear Programming and Finite Markovian Control Problems.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1983) Linear Programming and Finite Markovian Control Problems

Reference 54

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.359144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 77b1e009-01b4-4570-a34c-f0dc910c92d5 · outbound

This paper cites (2002) Finite state and action MDPs.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2002) Finite state and action MDPs

Reference 55

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.346335Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 6a429782-1d35-4861-a61a-7987653f325b · outbound

This paper cites (2019) Weak Feller property of non-linear filters.Systems & Control Letters 134, 104512.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2019) Weak Feller property of non-linear filters.Systems & Control Letters 134, 104512

Reference 56

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:59.116775Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 0a5d349b-516c-484e-bdb8-400220ee89a4 · outbound

This paper cites (1995) Controlled Queueing Systems.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1995) Controlled Queueing Systems

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:58.779835Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 61e273bc-0efa-4d6f-8b6a-d11ccd10b601 · outbound

This paper cites (2014) A bound for the number of different basic solutions gen- erated by the simplex method, Math.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2014) A bound for the number of different basic solutions gen- erated by the simplex method, Math

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:58.452103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation e045d53a-9fdd-415e-8361-04bce8e4767b · outbound

This paper cites (1931) ¨Uber die analytischen Methoden in der Wahrscheinlichkeitsrech- nung, Math.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1931) ¨Uber die analytischen Methoden in der Wahrscheinlichkeitsrech- nung, Math

Reference 59

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:58.123120Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation cd3036eb-b959-4ed0-a6c5-1ffb389a7dc5 · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 60

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:57.932131Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 5cde4945-0b34-4463-9129-3c820245507f · outbound

This paper cites Zhang, Y.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Zhang, Y

Reference 61

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:57.746267Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 74b8ffb0-701c-4244-85ec-331b98bc4d65 · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 62

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:57.559916Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation f34783df-3b70-4e1b-845a-0a64e6e10531 · outbound

This paper cites (1994) Markov Decision Processes: Discrete Stochastic Dynamic Pro- gramming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1994) Markov Decision Processes: Discrete Stochastic Dynamic Pro- gramming

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:57.353198Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation e0bfc70c-e3bb-41f3-8ae7-57ec67d75515 · outbound

This paper cites (1974) Incomplete information in Markovian decision models.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1974) Incomplete information in Markovian decision models

Reference 64

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:57.178998Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation bcc3746c-639d-495b-ad40-d9e36c9582f1 · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 65

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:55.690291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation f7b92261-0b1a-46c3-923e-0d3a965d06ee · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 66

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:54.862447Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 21723768-43e5-4271-b5c3-321646885830 · outbound

This paper cites (1994) Approximations of Discrete Time Partially Ob- served Control Problems, Applied Mathematics Monographs CNR, Giardini Editori, Pisa.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1994) Approximations of Discrete Time Partially Ob- served Control Problems, Applied Mathematics Monographs CNR, Giardini Editori, Pisa

Reference 67

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:54.351306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 134aeb4a-ed6c-4d38-8689-ff1d1538a01a · outbound

This paper cites (1975) Conditions for optimality and for the limit of n-stage optimal policies to be optimal.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1975) Conditions for optimality and for the limit of n-stage optimal policies to be optimal

Reference 68

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:54.078108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 93f93762-e495-491d-875d-eba4c2432fe3 · outbound

This paper cites (1993) Average optimality in dynamic programming with general state space.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1993) Average optimality in dynamic programming with general state space

Reference 69

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:53.909671Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 9ecf2b51-6427-4934-b45a-185eaa225a2c · outbound

This paper cites (2016) Improved and generalized upper bounds on the complexity of policy iteration.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2016) Improved and generalized upper bounds on the complexity of policy iteration

Reference 70

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:53.702952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 23b28e9a-36d3-40c3-bb2f-14c16031bc78 · outbound

This paper cites (1999) Stochastic Dynamic Programming and the Control of Queueing Sys- tems.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1999) Stochastic Dynamic Programming and the Control of Queueing Sys- tems

Reference 71

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:53.561058Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation f289402d-9b31-414a-9e98-00ab6d6138f3 · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 72

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:53.386000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 4f69da52-4da4-4f7d-a49c-b9312d87b4be · outbound

This paper cites (1963) Stochastic games, Proc.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1963) Stochastic games, Proc

Reference 73

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:53.238189Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 72f25b6d-e9e9-4f0c-a627-870562310b88 · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 74

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:53.076858Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation b7abd0a1-5c2d-4e7c-8892-29c979e78846 · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 75

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:52.916537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 14346acc-d84a-4cd9-9c53-a3a269bb5cc7 · outbound

This paper cites (2018) A general reinforcement learning algorithm that masters chess, shogi, and Go through self- play, Science 3662(6419) pp.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2018) A general reinforcement learning algorithm that masters chess, shogi, and Go through self- play, Science 3662(6419) pp

Reference 76

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:52.779041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation a4e78ac9-34a3-473c-afbf-06e580f7615a · outbound

This paper cites (1966) Positive Dynamic Programming.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1966) Positive Dynamic Programming

Reference 77

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:52.662636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 8028e512-94f7-4304-b3f5-4242ee1c00a1 · outbound

This paper cites (2018) Reinforcement Learning: An Introduction (2nd ed.).

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2018) Reinforcement Learning: An Introduction (2nd ed.)

Reference 78

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:52.520091Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation e6e00da7-5516-4172-8e98-07383699948d · outbound

This paper cites an unresolved cited work.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Unresolved cited work

Reference 79

Resolution: unresolved; raw_fallback, observed 2026-08-07T10:39:52.390396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 57b11d5b-dee2-4cbe-8b1a-7fe23beb735f · outbound

This paper cites (1990) Solving h-horizon, stationary Markov decision problems in time propor- tional to log(h), Oper.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1990) Solving h-horizon, stationary Markov decision problems in time propor- tional to log(h), Oper

Reference 80

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:52.221689Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 47c48f42-fbf4-48ad-b914-08501324fabf · outbound

This paper cites (2007) NP -hardness of checking the unichain condition in average cost MDPs.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2007) NP -hardness of checking the unichain condition in average cost MDPs

Reference 81

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:52.105531Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 153d0352-7ede-47d0-96e0-967012236931 · outbound

This paper cites On controls leading to optimal stationary regimes, Proceed- ings of the Steklov Institute of Mathematics, 71 (1964), pp.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments On controls leading to optimal stationary regimes, Proceed- ings of the Steklov Institute of Mathematics, 71 (1964), pp

Reference 82

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:51.922542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation d1ecaa0a-57d3-4ff7-924e-1e8bb87961d0 · outbound

This paper cites (2011) The simplex and policy-iteration methods are strongly polynomial for the Markov decision problem with a fixed discount rate, Math.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (2011) The simplex and policy-iteration methods are strongly polynomial for the Markov decision problem with a fixed discount rate, Math

Reference 83

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:51.790521Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation e3356a1f-1587-4680-9f5f-8785803da19a · outbound

This paper cites (1976) Reduction of a controlled Markov model with incomplete data to a problem with complete information in the case of Borel state and control spaces.

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments (1976) Reduction of a controlled Markov model with incomplete data to a problem with complete information in the case of Borel state and control spaces

Reference 84

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T10:39:51.607902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Coverage vector

Reference resolution

Outbound references

Pith citing papers