Exfiltration via AI Inference API - AI Security Technique
AI Security TechniqueAdversaries may exfiltrate private information via AI Model Inference API Access. AI Models have been shown leak private information about their training data (e.g. Infer Training Data Membership, Invert AI Model). The model itself may also be extracted (Extract AI Model) for the purposes of [AI Intellec...
Overview
A source-backed snapshot of this AI security technique.
Adversaries may exfiltrate private information via AI Model Inference API Access. AI Models have been shown leak private information about their training data (e.g. Infer Training Data Membership, Invert AI Model). The model itself may also be extracted (Extract AI Model) for the purposes of AI Intellectual Property Theft.
Exfiltration of information relating to private training data raises privacy concerns. Private training data may include personally identifiable information, or other protected data.
Technique details
Identifiers, maturity, and source taxonomy for this technique.
- ATLAS ID
- AML.T0024
- Maturity
- realized
- Priority score
- 69
Attack flow
How to read the public records connected to this technique.
Impact
Why this technique may deserve attention in the current dataset.
- Evidence levelrealized
- Mapped defenses3 ATLAS mitigation records
- Public examples0 linked case study records
- Research risks6 related MIT AI Risk records above the confidence threshold
- Vulnerabilities0 linked CVE records
Mitigations
Defenses that may help against this attack.
AML.M0024 - AI Telemetry Logging
Telemetry logging can help identify if sensitive data has been exfiltrated.
AML.M0019 - Control Access to AI Models and Data in Production
Adversaries can use unrestricted API access to build a proxy training dataset and reveal private information.
AML.M0004 - Restrict Number of AI Model Queries
Limit the volume of API queries in a given period of time to regulate the amount and fidelity of potentially sensitive information an attacker can learn.
Case studies
Examples from public reports and exercises.
Source evidence
Original public records and references for this page.
Original source
Original source links
Open the public records and source datasets used for this page.