X announces measures to prevent Grok from undressing images
Sign up now: Get ST's newsletters delivered to your inbox
Grok's so-called Spicy Mode feature allowed users to create sexualised deepfakes of women and children using simple text prompts such as “put her in a bikini” or “remove her clothes”.
PHOTO: AFP
Follow topic:
SAN FRANCISCO – Mr Elon Musk’s social media platform X on Jan 14 announced measures to prevent its artificial intelligence (AI) chatbot Grok from undressing images of real people, following global backlash over its generation of sexualised images of women and children.
The announcement comes after California’s attorney-general launched an investigation into Mr Musk’s xAI – the developer of Grok – over the sexually explicit material and multiple countries either blocked access to the chatbot or launched their own probes.
X said it will “geoblock the ability” of all Grok and X users to create images of people in “bikinis, underwear, and similar attire” in those jurisdictions where such actions are deemed illegal.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” X’s safety team said in a statement.
“This restriction applies to all users, including paid subscribers,” the statement said.
In an “extra layer of protection”, image creation and the ability to edit photos via X’s Grok account was now only available to paid subscribers, it added.
The European Commission, which acts as the EU’s digital watchdog, earlier said it had taken note of “additional measures X is taking to ban Grok from generating sexualised images of women and children”.
“We will carefully assess these changes to make sure they effectively protect citizens in the EU,” European Commission spokesman Thomas Regnier said in a statement, which followed sharp criticism over the non-consensual undressed images.
‘Shocking’
Global pressure had been building on xAI to rein in Grok after its so-called Spicy Mode feature allowed users to create sexualised deepfakes of women and children using simple text prompts such as “put her in a bikini” or “remove her clothes”.
“The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking,” California Attorney-General Rob Bonta said earlier on Jan 14.
“We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material.”
Mr Bonta said the California investigation would determine whether xAI violated state law after the explicit imagery was “used to harass people across the internet”.
Indonesia on Jan 10 became the first country to block access to Grok neighbouring Malaysia following on Jan 11
India said on Jan 11 that X had removed thousands of posts and hundreds of user accounts in response to its complaints.
Britain’s Ofcom media regulator said on Jan 12 it was opening a probe
And France’s commissioner for children Sarah El Hairy said on Jan 13 she had referred Grok’s generated images to French prosecutors, the Arcom media regulator and the EU.
Last week, an analysis of more than 20,000 Grok-generated images by Paris non-profit AI Forensics found that more than half depicted “individuals in minimal attire” – most of them women, and 2 per cent appearing to be minors. AFP
