HPO enables unbiased policy optimization in hybrid action spaces by mixing differentiable simulation gradients with score-function estimates, outperforming PPO as continuous dimensions increase.
arXiv preprint arXiv:2109.05490 , year=
2 Pith papers cite this work. Polarity classification is still indexing.
fields
cs.LG 2years
2026 2verdicts
UNVERDICTED 2representative citing papers
Comparative study of action factorization methods for hybrid action spaces across PPO/SAC/DQN finds branching dueling architectures effective and auto-regressive methods highest performing, with new VDN-PPO and PPO-MIX variants outperforming other PPO approaches.
citing papers explorer
-
Policy Optimization in Hybrid Discrete-Continuous Action Spaces via Mixed Gradients
HPO enables unbiased policy optimization in hybrid action spaces by mixing differentiable simulation gradients with score-function estimates, outperforming PPO as continuous dimensions increase.
-
Revisiting Action Factorization for Complex Action Spaces
Comparative study of action factorization methods for hybrid action spaces across PPO/SAC/DQN finds branching dueling architectures effective and auto-regressive methods highest performing, with new VDN-PPO and PPO-MIX variants outperforming other PPO approaches.