AI Could Generate Bespoke, Personalized Disinformation Campaigns

In addition to ramping up the pure output of disinformation, the report warns generative AI models could also amp up their quality. Specifically, the report warns of “hyper-targeted content” directed to specific users to mislead or deceive them. AI models could, they warn, create “bespoke” messages targeting individuals online rather than large groups. Worse still, those targeted attacks may improve over time as the AI models learn from past attacks.
“One should expect that as AI-driven personalised disinformation campaigns unfold, these AIs will be able to learn from millions of interactions and become better at influencing and manipulating humans, possibly even becoming better than humans at this,” the paper notes.