Goal-directedness cannot be measured objectively; existing behavioral and mechanistic measures only reveal a fit between the chosen formal model and the agent, so research should shift to multi-agent simulation.
Modeling AGI Safety Frameworks with Causal Influence Diagrams
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Proposals for safe AGI systems are typically made at the level of frameworks, specifying how the components of the proposed system should be trained and interact with each other. In this paper, we model and compare the most promising AGI safety frameworks using causal influence diagrams. The diagrams show the optimization objective and causal assumptions of the framework. The unified representation permits easy comparison of frameworks and their assumptions. We hope that the diagrams will serve as an accessible and visual introduction to the main AGI safety frameworks.
citation-role summary
background 1
citation-polarity summary
fields
cs.MA 1years
2025 1verdicts
REJECT 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Goal-Directedness is in the Eye of the Beholder
Goal-directedness cannot be measured objectively; existing behavioral and mechanistic measures only reveal a fit between the chosen formal model and the agent, so research should shift to multi-agent simulation.