PromptRiskDBThreat intelligence atlas
AI Risk

Risks from data (Risks of improper content and poisoning in training data)

"If the training data includes illegal or harmful information, such as false, biased, or IPR-infringing content, or lacks diversity in its sources, the output may include harmful content like illegal, malicious, or extreme information. Training data is also at risk of being poisoned through tampering, error injection, or misleading actions by attackers. This can interfere with the model's probability distribution...

AI Risk1. Discrimination & Toxicity1.2 > Exposure to toxic content1 - Pre-deployment

Record summary

A quick snapshot of what this page covers.

Techniques8Attack methods connected to this risk.
Mitigations11Defenses that may help with related attacks.
Domain1. Discrimination & ToxicityThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

"If the training data includes illegal or harmful information, such as false, biased, or IPR-infringing content, or lacks diversity in its sources, the output may include harmful content like illegal, malicious, or extreme information. Training data is also at risk of being poisoned through tampering, error injection, or misleading actions by attackers. This can interfere with the model's probability distribution, reducing its accuracy and reliability."

Domain1. Discrimination & Toxicity
Subdomain1.2 > Exposure to toxic content
Entity1 - Human
Intent3 - Other
Timing1 - Pre-deployment
CategoryAI's inherent safety risks
SubcategoryRisks from data (Risks of improper content and poisoning in training data)

Suggested mitigations

Defenses that may help with related attacks.

AI Telemetry Logging

DeploymentMonitoring and Maintenance
LifecycleDeployment + 1 moreCategoryTechnical - Cyber

Validate AI Model

ML Model EvaluationMonitoring and Maintenance
LifecycleML Model Evaluation + 1 moreCategoryTechnical - ML

Code Signing

Deployment
LifecycleDeploymentCategoryTechnical - Cyber

Source

Research source for this risk, when available.