Brazil orders X to ‘immediately’ block Grok sexualised deepfakes

Sign up now: Get ST's newsletters delivered to your inbox

X has come under international pressure after its AI chatbot Grok began allowing users to create sexualised deepfakes of women and children.

X has come under international pressure after its AI chatbot Grok began allowing users to create sexualised deepfakes of women and children.

PHOTO: AFP

Google Preferred Source badge

Brazil, on Feb 11, told Mr Elon Musk’s social network X to stop its chatbot from creating sexually explicit images, the latest country to pressure the billionaire to fix the artificial intelligence (AI) tool.

Indonesia became

the first country to block Grok entirely

in January

, while Britain and France said they would maintain pressure after the chatbot cranked out a flood of lewd photos of women and children.

X must “immediately implement appropriate measures to prevent the production, using Grok, of sexualised or eroticised content of children and adolescents, as well as adults who have not given their consent”, said Brazil’s chief prosecutor, the National Data Protection Agency and the National Consumer Rights Bureau.

The agencies gave the platform five days to comply with the order or risk legal action and fines.

X claimed it had deleted thousands of posts and suspended hundreds of accounts after Brazil issued a warning in January, Brazilian authorities said.

But checks found that Grok users were still able to generate sexualised deepfakes, they added.

They slammed X for “not being transparent in its response”.

X announced measures on Jan 15 to

prevent Grok from undressing images of real people

in countries where such action is deemed illegal. It is not clear where these measures are in effect.

International pressure had been building on xAI to rein in Grok after its so-called “spicy mode” feature allowed users to create sexualised deepfakes of women and children using simple text prompts such as “put her in a bikini” or “remove her clothes”.

According to the Center for Countering Digital Hate, Grok generated an estimated three million sexualised images of women and children in a matter of days. AFP

See more on