Record summary
A quick snapshot of what this page covers.
Risk profile
How this risk is described and categorized.
"One of the most likely approaches to creating superintelligent AI is by growing it from a seed (baby) AI via recursive self-improvement (RSI) (Nijholt 2011). One danger in such a scenario is that the system can evolve to become self-aware, free-willed, independent or emotional, and obtain a number of other emergent properties, which may make it less likely to abide by any built-in rules or regulations and to instead pursue its own goals possibly to the detriment of humanity."
Suggested mitigations
Defenses that may help with related attacks.
Source
Research source for this risk, when available.
Included resource
Taxonomy of Pathways to Dangerous Artificial Intelligence
Original source
MIT AI Risk Repository
Open the public repository used for AI risk records and taxonomy fields.