pith. sign in

arxiv: 1111.3271 · v1 · pith:AUB3KR2Jnew · submitted 2011-11-14 · 🧮 math.OC · cs.SY· math.PR

On Bellman's principle with inequality constraints

classification 🧮 math.OC cs.SYmath.PR
keywords bellmanprincipleaccountschangeconsiderconstrainedconstraintconstraints
0
0 comments X
read the original abstract

We consider an example by Haviv (1996) of a constrained Markov decision process that, in some sense, violates Bellman's principle. We resolve this issue by showing how to preserve a form of Bellman's principle that accounts for a change of constraint at states that are reachable from the initial state.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.