MASP meta-learns a similarity matrix over macro-actions and regularizes Q-values so that similar actions move together, improving exploration and performance in augmented-action-space RL.
Efficient Black-Box Planning Using Macro-Actions with Focused Effects
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
The difficulty of deterministic planning increases exponentially with search-tree depth. Black-box planning presents an even greater challenge, since planners must operate without an explicit model of the domain. Heuristics can make search more efficient, but goal-aware heuristics for black-box planning usually rely on goal counting, which is often quite uninformative. In this work, we show how to overcome this limitation by discovering macro-actions that make the goal-count heuristic more accurate. Our approach searches for macro-actions with focused effects (i.e. macros that modify only a small number of state variables), which align well with the assumptions made by the goal-count heuristic. Focused macros dramatically improve black-box planning efficiency across a wide range of planning domains, sometimes beating even state-of-the-art planners with access to a full domain model.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Meta-learning how to Share Credit among Macro-Actions
MASP meta-learns a similarity matrix over macro-actions and regularizes Q-values so that similar actions move together, improving exploration and performance in augmented-action-space RL.