APromptRiskDBThreat intelligence atlas
AI Risk

Bias and discrimination (bias in training datasets)

"AI experts consider training data to be the most salient source of bias in generative AI models. For example, GPT- 2’s training data comes from outbound links from Reddit, a social network often criticized for hosting anti-feminist content.351 As a result, AI models trained on such data are more likely to produce outputs that reflect these biases."

AI Risk1. Discrimination & Toxicity1.1 > Unfair discrimination and misrepresentation1 - Pre-deployment

Record summary

A quick snapshot of what this page covers.

Techniques1Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain1. Discrimination & ToxicityThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

Domain1. Discrimination & Toxicity
Subdomain1.1 > Unfair discrimination and misrepresentation
Entity3 - Other
Intent2 - Unintentional
Timing1 - Pre-deployment
CategoryEthical and social risks
SubcategoryBias and discrimination (bias in training datasets)

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.