The paper proposes Bayesian composite risk stochastic control and MDP models with belief-dependent policies, and proves dynamic programming and asymptotic convergence results.
An Approximate Solution Method for Large Risk-Averse Markov Decision Processes
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Stochastic domains often involve risk-averse decision makers. While recent work has focused on how to model risk in Markov decision processes using risk measures, it has not addressed the problem of solving large risk-averse formulations. In this paper, we propose and analyze a new method for solving large risk-averse MDPs with hybrid continuous-discrete state spaces and continuous action spaces. The proposed method iteratively improves a bound on the value function using a linearity structure of the MDP. We demonstrate the utility and properties of the method on a portfolio optimization problem.
citation-role summary
background 1
citation-polarity summary
fields
math.OC 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
A Bayesian Composite Risk Approach for Stochastic Optimal Control and Markov Decision Processes
The paper proposes Bayesian composite risk stochastic control and MDP models with belief-dependent policies, and proves dynamic programming and asymptotic convergence results.