Record summary
A quick snapshot of what this page covers.
Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain5. Human-Computer InteractionThe broad risk area this belongs to.
Risk profile
How this risk is described and categorized.
"AI systems can undermine human autonomy, if they allow for habitually trusting the AI’s suggestions without sufficient exercising of human agency. Over time, a user may develop unjustified trust in or dependence on the system, or rely on its advice for tasks outside the system’s domain of expertise [205, 42]. In particular, less confident users (or users in emotional distress) can be more prone to “overtrust” a system [219]."
Domain5. Human-Computer Interaction
Subdomain5.2 > Loss of human agency and autonomy
Entity1 - Human
Intent2 - Unintentional
Timing2 - Post-deployment
CategoryImpacts of AI (Societal Impacts)
SubcategoryOverreliance on AI system undermining user autonomy
Suggested mitigations
Defenses that may help with related attacks.
No propagated mitigations. No defense is available through the connected attack methods.
Source
Research source for this risk, when available.
Included resource
Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems
Original source
MIT AI Risk Repository
Open the public repository used for AI risk records and taxonomy fields.