PG-DPO is a new variational framework that replaces Bellman recursion with a Pontryagin-guided adjoint-MC projection for RL under non-exponential discounting and shows gains on hyperbolic and survival benchmarks.
Being serious about non-commitment: subgame perfect equilibrium in continuous time
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
This paper characterizes differentiable subgame perfect equilibria in a continuous time intertemporal decision optimization problem with non-constant discounting. The equilibrium equation takes two different forms, one of which is reminescent of the classical Hamilton-Jacobi-Bellman equation of optimal control, but with a non-local term. We give a local existence result, and several examples in the consumption saving problem. The analysis is then applied to suggest that non constant discount rates generate an indeterminacy of the steady state in the Ramsey growth model. Despite its indeterminacy, the steady state level is robust to small deviations from constant discount rates.
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Beyond the Bellman Recursion: A Pontryagin-Guided Framework for Non-Exponential Discounting
PG-DPO is a new variational framework that replaces Bellman recursion with a Pontryagin-guided adjoint-MC projection for RL under non-exponential discounting and shows gains on hyperbolic and survival benchmarks.