PromptRiskDBThreat intelligence atlas
AI Risk

Widespread use of persuasive tools contributes to splintered epistemic communities

"Even without deliberate misuse, widespread use of powerful persuasion tools could have negative impacts. If such tools were used by many different groups to advance many different ideas, we could see the world splintering into isolated “epistemic communities”, with little room for dialogue or transfer between communities. A similar scenario could emerge via the increasing personalisation of people’s online experi...

AI Risk3. Misinformation3.2 > Pollution of information ecosystem and loss of consensus reality3 - Other

Record summary

A quick snapshot of what this page covers.

Techniques1Attack methods connected to this risk.
Mitigations0Defenses that may help with related attacks.
Domain3. MisinformationThe broad risk area this belongs to.

Risk profile

How this risk is described and categorized.

"Even without deliberate misuse, widespread use of powerful persuasion tools could have negative impacts. If such tools were used by many different groups to advance many different ideas, we could see the world splintering into isolated “epistemic communities”, with little room for dialogue or transfer between communities. A similar scenario could emerge via the increasing personalisation of people’s online experiences—in other words, we may see a continuation of the trend towards “filter bubbles” and “echo chambers”, driven by content selection algorithms, that some argue is already happening [3, 25, 51]."

Domain3. Misinformation
Subdomain3.2 > Pollution of information ecosystem and loss of consensus reality
Entity1 - Human
Intent2 - Unintentional
Timing3 - Other
CategoryWorsened epistemic processes for society
SubcategoryWidespread use of persuasive tools contributes to splintered epistemic communities

Suggested mitigations

Defenses that may help with related attacks.

No propagated mitigations. No defense is available through the connected attack methods.

Source

Research source for this risk, when available.