REVIEW 2 cited by
A Black Swan Hypothesis: The Role of Human Irrationality in AI Safety
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Black swan events are statistically rare occurrences that carry extremely high risks. A typical view of defining black swan events is heavily assumed to originate from an unpredictable time-varying environments; however, the community lacks a comprehensive definition of black swan events. To this end, this paper challenges that the standard view is incomplete and claims that high-risk, statistically rare events can also occur in unchanging environments due to human misperception of their value and likelihood, which we call as spatial black swan event. We first carefully categorize black swan events, focusing on spatial black swan events, and mathematically formalize the definition of black swan events. We hope these definitions can pave the way for the development of algorithms to prevent such events by rationally correcting human perception.
Forward citations
Cited by 2 Pith papers
-
Toward Evaluative Thinking: Meta Policy Optimization with Evolving Reward Models
MPO uses a meta reward model to continuously rewrite the reward model's evaluation prompt during PPO training, and the resulting models beat static-prompt RLAIF baselines on four tasks.
-
Evolution and The Knightian Blindspot of Machine Learning
ML's formalisms, particularly RL's, exclude Knightian uncertainty, and evolution's diversify-and-filter mechanisms point toward a direct remedy.
Discussion (0). Continue with ORCID to comment.