PromptRiskDBThreat intelligence atlas
AI Risk

Over- or under-reliance

"In AI-assisted decision-making tasks, reliance measures how much a person trusts (and potentially acts on) a model’s output. Over-reliance occurs when a person puts too much trust in a model, accepting a model’s output when the model’s output is likely incorrect. Under-reliance is the opposite, where the person doesn’t trust the model but should."

AI Risk5. Human-Computer Interaction5.1 > Overreliance and unsafe use2 - Post-deployment

Record summary

A quick snapshot of what this page covers.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain5. Human-Computer InteractionThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

Domain5. Human-Computer Interaction
Subdomain5.1 > Overreliance and unsafe use
Entity1 - Human
Intent2 - Unintentional
Timing2 - Post-deployment
CategoryOutput risks (Value alignment)
SubcategoryOver- or under-reliance

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.