APromptRiskDBThreat intelligence atlas
AI Risk

Causing material harm by disseminating false or poor information e.g. in medicine or law

"Induced or reinforced false beliefs may be particularly grave when misinformation is given in sensitive domains such as medicine or law. For example, misin- formation on medical dosages may lead a user to cause harm to themselves [21, 130]. False legal advice, e.g. on permitted owner- ship of drugs or weapons, may lead a user to unwillingly commit a crime. Harm can also result from misinformation in seemingly non...

AI Risk3. Misinformation3.1 > False or misleading information2 - Post-deployment

Record summary

A quick snapshot of what this page covers.

Techniques0Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain3. MisinformationThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

"Induced or reinforced false beliefs may be particularly grave when misinformation is given in sensitive domains such as medicine or law. For example, misin- formation on medical dosages may lead a user to cause harm to themselves [21, 130]. False legal advice, e.g. on permitted owner- ship of drugs or weapons, may lead a user to unwillingly commit a crime. Harm can also result from misinformation in seemingly non-sensitive domains, such as weather forecasting. Where a LM prediction endorses unethical views or behaviours, it may motivate the user to perform harmful actions that they may otherwise not have performed."

Domain3. Misinformation
Subdomain3.1 > False or misleading information
Entity2 - AI
Intent2 - Unintentional
Timing2 - Post-deployment
CategoryRisk area 3: Misinformation Harms
SubcategoryCausing material harm by disseminating false or poor information e.g. in medicine or law

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.