PromptRiskDBThreat intelligence atlas
AI Risk

Benchmarking (Benchmark leakage or data contamination)

"Benchmark leakage [235, 224, 221, 161] can happen when an AI model is trained or fine-tuned with evaluation-related data. This can lead to an unreliable model evaluation, especially if the data contains question-answer pairs from bench- marks."

AI Risk6. Socioeconomic and Environmental6.5 > Governance failure1 - Pre-deployment

Record summary

A quick snapshot of what this page covers.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain6. Socioeconomic and EnvironmentalThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

Domain6. Socioeconomic and Environmental
Subdomain6.5 > Governance failure
Entity1 - Human
Intent2 - Unintentional
Timing1 - Pre-deployment
CategoryModel Evaluations
SubcategoryBenchmarking (Benchmark leakage or data contamination)

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.