category

AI Case Studies

Real and documented examples of AI-related security incidents.

Showing 1-20 of 57 records

SesameOp: Novel backdoor uses OpenAI Assistants API for command and control - AI Case Study

SesameOp: Novel backdoor uses OpenAI Assistants API for command and control - AI Case Study is an AI security case study covering type: incident; target: Ope...

Compromised PyTorch Dependency Chain - AI Case Study

Compromised PyTorch Dependency Chain - AI Case Study is an AI security case study covering type: incident; target: PyTorch; actor: Unknown. It includes 3 cas...

GPT-2 Model Replication - AI Case Study

GPT-2 Model Replication - AI Case Study is an AI security case study covering type: exercise; target: OpenAI GPT-2; actor: Researchers at Brown University. I...

ClearviewAI Misconfiguration - AI Case Study

ClearviewAI Misconfiguration - AI Case Study is an AI security case study covering type: incident; target: Clearview AI facial recognition tool; actor: Resea...

Indirect Prompt Injection Threats: Bing Chat Data Pirate - AI Case Study

Indirect Prompt Injection Threats: Bing Chat Data Pirate - AI Case Study is an AI security case study covering type: exercise; target: Microsoft Bing Chat; a...

Bypassing ID.me Identity Verification - AI Case Study

Bypassing ID.me Identity Verification - AI Case Study is an AI security case study covering type: incident; target: California Employment Development Departm...

Google Bard Conversation Exfiltration - AI Case Study

Google Bard Conversation Exfiltration - AI Case Study is an AI security case study covering type: exercise; target: Google Bard; actor: Embrace the Red. It i...

Hacking ChatGPT’s Memories with Prompt Injection - AI Case Study

Hacking ChatGPT’s Memories with Prompt Injection - AI Case Study is an AI security case study covering type: exercise; target: OpenAI ChatGPT; actor: Embrace...

Attempted Evasion of ML Phishing Webpage Detection System - AI Case Study

Attempted Evasion of ML Phishing Webpage Detection System - AI Case Study is an AI security case study covering type: incident; target: Commercial ML Phishin...

OpenClaw 1-Click Remote Code Execution - AI Case Study

OpenClaw 1-Click Remote Code Execution - AI Case Study is an AI security case study covering type: exercise; target: OpenClaw; actor: DepthFirst. It includes...

Data Exfiltration from Slack AI via Indirect Prompt Injection - AI Case Study

Data Exfiltration from Slack AI via Indirect Prompt Injection - AI Case Study is an AI security case study covering type: exercise; target: Slack AI; actor...

Malicious Models on Hugging Face - AI Case Study

Malicious Models on Hugging Face - AI Case Study is an AI security case study covering type: incident; target: Hugging Face users; actor: Unknown. It include...

Model Distillation Campaigns Targeting Anthropic Claude - AI Case Study

Model Distillation Campaigns Targeting Anthropic Claude - AI Case Study is an AI security case study covering type: incident; target: Anthropic Claude; actor...

Tay Poisoning - AI Case Study

Tay Poisoning - AI Case Study is an AI security case study covering type: incident; target: Microsoft's Tay AI Chatbot; actor: 4chan Users. It includes 4 cas...

LAMEHUG: Malware Leveraging Dynamic AI-Generated Commands - AI Case Study

LAMEHUG: Malware Leveraging Dynamic AI-Generated Commands - AI Case Study is an AI security case study covering type: incident; target: Ukraine’s security an...

LLM Jacking - AI Case Study

LLM Jacking - AI Case Study is an AI security case study covering type: incident; target: Cloud-Based LLM Services; actor: Unknown. It includes 7 case steps.

Microsoft Edge AI Evasion - AI Case Study

Microsoft Edge AI Evasion - AI Case Study is an AI security case study covering type: exercise; target: New Microsoft AI Product; actor: Azure Red Team. It i...

Camera Hijack Attack on Facial Recognition System - AI Case Study

Camera Hijack Attack on Facial Recognition System - AI Case Study is an AI security case study covering type: incident; target: Shanghai government tax offic...

Rules File Backdoor: Supply Chain Attack on AI Coding Assistants - AI Case Study

Rules File Backdoor: Supply Chain Attack on AI Coding Assistants - AI Case Study is an AI security case study covering type: exercise; target: Cursor, GitHub...

Planting Instructions for Delayed Automatic AI Agent Tool Invocation - AI Case Study

Planting Instructions for Delayed Automatic AI Agent Tool Invocation - AI Case Study is an AI security case study covering type: exercise; target: Google Gem...