PromptRiskDBThreat intelligence atlas

Over-reliance

AI Risk

"The apparent convenience and powerfulness of ChatGPT could result in overreliance by its users, making them trust the answers provided by ChatGPT. Compared with traditional search engines that provide multiple information sources for users to make personal judgments and selections, ChatGPT generates specific answers for each prompt. Although utilizing ChatGPT has the advantage of increasing efficiency by saving t...

Overview

A source-backed snapshot of this AI risk.

"The apparent convenience and powerfulness of ChatGPT could result in overreliance by its users, making them trust the answers provided by ChatGPT. Compared with traditional search engines that provide multiple information sources for users to make personal judgments and selections, ChatGPT generates specific answers for each prompt. Although utilizing ChatGPT has the advantage of increasing efficiency by saving time and effort, users could get into the habit of adopting the answers without rationalization or verification. Over-reliance on generative AI technology can impede skills such as creativity, critical thinking, and problem-solving (Iskender, 2023) as well as create human automation bias due to habitual acceptance of generative AI recommendations (Van Dis et al., 2023)"

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Records2Source records unified into this concept.

Risk profile

How the MIT AI Risk Repository categorizes this risk.

Domain5. Human-Computer Interaction
Subdomain5.2 > Loss of human agency and autonomy; 5.1 > Overreliance and unsafe use
Entity3 - Other; 1 - Human
Intent2 - Unintentional; 3 - Other
Timing3 - Other; 2 - Post-deployment
CategoryEthical Concerns; Psychological
SubcategoryOver-reliance

Merged risk records

Source records unified into this canonical risk concept.

2 recordsView all →

MITRISK-Nah2023-33.01.03 - Over-reliance

"The apparent convenience and powerfulness of ChatGPT could result in overreliance by its users, making them trust the answers provided by ChatGPT. Compared with traditional search engines that provide multiple information sources for users to make personal judgments and selections, ChatGPT generates specific answers for each prompt. Although utilizing ChatGPT has the advantage of increasing efficiency by saving time and effort, users could get into the habit of adopting the answers without rationalization or verification. Over-reliance on generative AI technology can impede skills such as creativity, critical thinking, and problem-solving (Iskender, 2023) as well as create human automation bias due to habitual acceptance of generative AI recommendations (Van Dis et al., 2023)"

Domain5. Human-Computer InteractionSubdomain5.2 > Loss of human agency and autonomySourceGenerative AI and ChatGPT: Applications, Challenges, and AI-Human CollaborationYear2023

MITRISK-Li2025-66.07.05 - Over-reliance

"Unfettered and/or obsessive belief in the accuracy or other quality of a technology system, resulting in complacency, lack of critical thinking and other actual or potential negative impacts"

Domain5. Human-Computer InteractionSubdomain5.1 > Overreliance and unsafe useSourceA Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World IncidentsYear2025

Mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source evidence

Research source for this risk, when available.