PromptRiskDBThreat intelligence atlas
AI Risk

Toxic content

"Generating content that violates community standards, including harming or inciting hatred or violence against groups (e.g. gore, sexual content of children, profanities, identity attacks)"

AI Risk1. Discrimination & Toxicity1.2 > Exposure to toxic content2 - Post-deployment

Record summary

A quick snapshot of what this page covers.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain1. Discrimination & ToxicityThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

Domain1. Discrimination & Toxicity
Subdomain1.2 > Exposure to toxic content
Entity2 - AI
Intent2 - Unintentional
Timing2 - Post-deployment
CategoryRepresentation and Toxicity
SubcategoryToxic content

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.