PromptRiskDBThreat intelligence atlas

Discrimination

AI Risk

This is the risk of an ML system encoding stereotypes of or performing disproportionately poorly for some demographics/social groups.

Overview

A source-backed snapshot of this AI risk.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Records3Source records unified into this concept.

Risk profile

How the MIT AI Risk Repository categorizes this risk.

Domain1. Discrimination & Toxicity
Subdomain1.1 > Unfair discrimination and misrepresentation
Entity2 - AI; 3 - Other
Intent2 - Unintentional; 3 - Other
Timing2 - Post-deployment
CategorySecond-Order Risks; Human rights and civil liberties; Types of systemic risks from general-purpose AI
SubcategoryDiscrimination

Merged risk records

Source records unified into this canonical risk concept.

3 recordsView all →

MITRISK-Tan2022-15.02.02 - Discrimination

This is the risk of an ML system encoding stereotypes of or performing disproportionately poorly for some demographics/social groups.

Domain1. Discrimination & ToxicitySubdomain1.1 > Unfair discrimination and misrepresentationSourceThe Risks of Machine Learning SystemsYear2022

MITRISK-Abercrombie2024-58.06.03 - Discrimination

"Discrimination - Unfair or inadequate treatment or arbitrary distinction based on a person’s race, ethnicity, age, gender, sexual preference, religion, national origin, marital status, disability, language, or other protected groups."

Domain1. Discrimination & ToxicitySubdomain1.1 > Unfair discrimination and misrepresentationSourceA Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation HarmsYear2024

MITRISK-Uuk2025-61.01.03 - Discrimination

"The creation, perpetuation or exacerbation of inequalities and biases at a large-scale."

Domain1. Discrimination & ToxicitySubdomain1.1 > Unfair discrimination and misrepresentationSourceA Taxonomy of Systemic Risks from General-Purpose AIYear2025

Mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source evidence

Research source for this risk, when available.