PromptRiskDBThreat intelligence atlas

Data bias

AI Risk

"Specifically, data bias refers to certain groups or certain types of elements that are over-weighted or over-represented than others in AI/ ML models, or variables that are crucial to characterize a phenomenon of interest, but are not properly captured by the learned models."

Overview

A source-backed snapshot of this AI risk.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Records2Source records unified into this concept.

Risk profile

How the MIT AI Risk Repository categorizes this risk.

Domain1. Discrimination & Toxicity
Subdomain1.1 > Unfair discrimination and misrepresentation
Entity2 - AI; 1 - Human
Intent2 - Unintentional
Timing1 - Pre-deployment; 2 - Post-deployment
CategoryData-level risk; Training Data Risks (Fairness)
SubcategoryData bias

Merged risk records

Source records unified into this canonical risk concept.

2 recordsView all →

MITRISK-Zhang2022-21.01.01 - Data bias

"Specifically, data bias refers to certain groups or certain types of elements that are over-weighted or over-represented than others in AI/ ML models, or variables that are crucial to characterize a phenomenon of interest, but are not properly captured by the learned models."

Domain1. Discrimination & ToxicitySubdomain1.1 > Unfair discrimination and misrepresentationSourceTowards risk-aware artificial intelligence and machine learning systems: An overviewYear2022

MITRISK-IBM2025-65.04.01 - Data bias

"Historical and societal biases that are present in the data are used to train and fine-tune the model."

Domain1. Discrimination & ToxicitySubdomain1.1 > Unfair discrimination and misrepresentationSourceAI Risk AtlasYear2025

Mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source evidence

Research source for this risk, when available.