PromptRiskDBThreat intelligence atlas
AI Risk

Benchmarking (Guideline contamination)

"Guideline contamination refers to scenarios where instructions for the collec- tion, annotation, or use of the dataset are exposed to the model [170]. These instructions may contain explicit data-label pairs that can improve the model’s capabilities for the task."

AI Risk6. Socioeconomic and Environmental6.5 > Governance failure1 - Pre-deployment

Record summary

A quick snapshot of what this page covers.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain6. Socioeconomic and EnvironmentalThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

Domain6. Socioeconomic and Environmental
Subdomain6.5 > Governance failure
Entity1 - Human
Intent2 - Unintentional
Timing1 - Pre-deployment
CategoryModel Evaluations
SubcategoryBenchmarking (Guideline contamination)

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.