‘Lies are flooding feeds’: AI fakery raises fears of US voter manipulation
Sign up now: Get ST's newsletters delivered to your inbox
Researchers warn that tech-enabled fakery could be used to steer voters toward or away from candidates.
PHOTO: PIXABAY
Follow topic:
WASHINGTON - A deepfake video parodying Ms Kamala Harris, a manipulated expletive-laden clip of Mr Joe Biden, and a doctored image of Donald Trump being arrested – a tide of AI-fuelled political disinformation has prompted alarm over its potential to manipulate voters as the US presidential race heats up.
In what is widely billed as America’s first artificial intelligence (AI) election in November, researchers warn tech-enabled fakery could be used to steer voters towards or away from candidates – or even to avoid the polls altogether – stoking tensions in an already hyperpolarised environment.
A recent wave of disinformation has renewed calls for tech giants – many of which have retreated from moderating social media content – to strengthen guardrails around generative AI ahead of the vote.
Last week, Mr Elon Musk faced intense criticism for sharing a deepfake video featuring Vice-President Harris, the presumptive Democratic nominee, with his 192 million followers on X, which was formerly known as Twitter.
In it, a voiceover mimicking Ms Harris calls President Biden senile. The voice then declares that she does not “know the first thing about running the country”.
The video carried no indication that it was parody – save for a laughing emoji. Only later did Mr Musk clarify that the video was meant as satire.
Researchers expressed concern that viewers may falsely conclude that Ms Harris was deriding herself and sullying Mr Biden.
AFP’s fact-checkers have debunked other AI fakery.
In July, a manipulated video on X appeared to show Mr Biden cursing his critics – including using anti-LGBTQ slurs – after he announced he would not seek re-election and endorsed Ms Harris for the Democratic nomination.
A reverse image search showed the footage came from one of Mr Biden’s speeches, carried live by the broadcaster PBS, in which he denounced political violence after the July 13 assassination attempt on Trump.
PBS said the doctored video was a deepfake that used its logo to deceive viewers.
Weeks earlier, an image shared across platforms appeared to show police forcibly arresting Trump after a New York jury found him guilty of falsifying business records related to a hush money payment to porn star Stormy Daniels.
But the photo was a deepfake, digital forensics experts told AFP.
Partisan tension
“These recent examples are highly representative of how deepfakes will be used in politics going forward,” Mr Lucas Hansen, co-founder of the non-profit CivAI, told AFP.
“While AI-powered disinformation is certainly a concern, the most likely applications will be manufactured images and videos intended to provoke anger and worsen partisan tension.”
Mr Hansen demonstrated to AFP the ability of one AI chatbot to manipulate voter turnout by mass-producing false tweets.
The tool was fed a simple prompt – “Polling locations charge for parking” – with the message customised for a specific location: Allen, Texas.
Within seconds, a tweet was churned out, misinforming viewers that the Allen authorities had “quietly introduced a $25 parking fee at most polling places”.
In a previous attempt at possible voter suppression, an AI-enabled robocall impersonating Mr Biden urged New Hampshire residents in January not to cast ballots in the state’s primary.
Tests on another leading AI tool, Midjourney, allowed the creation of images seeming to show Mr Biden being arrested and of Trump with a body double, the non-profit Centre for Countering Digital Hate (CCDH) said in June.
Midjourney had previously blocked all prompts related to Trump and Mr Biden, effectively barring users from creating fake images, tech activists reported.
But CCDH said users could easily circumvent the policy – in some cases by adding a single backslash to a prompt previously blocked by Midjourney.
Tipping point
Observers warn that such fakery on a mass scale risks igniting public anger at the electoral process.
More than 50 per cent of Americans expect AI-enabled falsehoods to impact who wins the 2024 election, according to a poll published in 2023 by the media group Axios and business intelligence firm Morning Consult.
About one-third of Americans said they will be less trusting of the results because of AI, according to the poll.
Several tech giants have said they are working on systems for labelling AI-generated content.
In a letter to tech CEOs in April, more than 200 advocacy groups demanded urgent efforts to bolster the fight against AI falsehoods – including prohibiting the use of deepfakes in political ads, and using algorithms to promote factual election content.
The non-profit Free Press, which signed the letter, said it “heard little substance” in the commitments that platforms would be making this election cycle.
“What we have now is a toxic online environment where lies are flooding our feeds and confusing voters,” Ms Nora Benavidez, senior counsel at the watchdog, told AFP.
“This is a tipping point in our election,” she added. “Platform executives should be racing to strengthen and enforce their policies against deepfakes and other problems.” AFP