PromptRiskDBThreat intelligence atlas
AI Risk

Cyberspace risks (Risks of confusing facts, misleading users, and bypassing authentication)

"AI systems and their outputs, if not clearly labeled, can make it difficult for users to discern whether they are interacting with AI and to identify the source of generated content. This can impede users' ability to determine the authenticity of information, leading to misjudgment and misunderstanding. Additionally, AI-generated highly realistic images, audio, and videos may circumvent existing identity verifica...

AI Risk3. Misinformation3.1 > False or misleading information2 - Post-deployment

Record summary

A quick snapshot of what this page covers.

Techniques1Attack methods connected to this risk.
Mitigations1Defenses that may help with related attacks.
Domain3. MisinformationThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

"AI systems and their outputs, if not clearly labeled, can make it difficult for users to discern whether they are interacting with AI and to identify the source of generated content. This can impede users' ability to determine the authenticity of information, leading to misjudgment and misunderstanding. Additionally, AI-generated highly realistic images, audio, and videos may circumvent existing identity verification mechanisms, such as facial recognition and voice recognition, rendering these authentication processes ineffective."

Domain3. Misinformation
Subdomain3.1 > False or misleading information
Entity3 - Other
Intent1 - Intentional
Timing2 - Post-deployment
CategorySafety risks in AI Applications
SubcategoryCyberspace risks (Risks of confusing facts, misleading users, and bypassing authentication)

Suggested mitigations

Defenses that may help with related attacks.

Source

Research source for this risk, when available.