PromptRiskDBThreat intelligence atlas
AI Risk

General Evaluations (Difficulty of identification and measurement of capabilities)

"The capabilities of general-purpose AI systems can be difficult to measure, compared to the capabilities of more limited and fixed-purpose AI systems. This is in part due to a broader distribution of potential risks, a lack of well-defined metrics to evaluate these risks, and risks from unpredictable (or emergent) AI model properties."

AI Risk7. AI System Safety, Failures, & Limitations7.4 > Lack of transparency or interpretability3 - Other

Record summary

A quick snapshot of what this page covers.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain7. AI System Safety, Failures, & LimitationsThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

Domain7. AI System Safety, Failures, & Limitations
Subdomain7.4 > Lack of transparency or interpretability
Entity3 - Other
Intent3 - Other
Timing3 - Other
CategoryModel Evaluations
SubcategoryGeneral Evaluations (Difficulty of identification and measurement of capabilities)

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.