Elon Musk’s X announces geoblocks and subscriber-only access for Grok’s image features after global probes into non-consensual explicit AI content
SAN FRANCISCO: Platform X has announced measures to prevent its AI chatbot Grok from generating undressed images of real people.
The move follows a global backlash over the tool creating sexualised photos of women and children.
X said it will “geoblock the ability” for all users to create images of people in “bikinis, underwear, and similar attire” in jurisdictions where such actions are illegal.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” X’s safety team stated.
“This restriction applies to all users, including paid subscribers.”
An extra layer of protection now limits image creation and editing via Grok to paid subscribers only.
The announcement came after California’s attorney general launched an investigation into Musk’s xAI, the developer of Grok.
Multiple countries have either blocked access to the chatbot or launched their own probes.
Global pressure mounted after Grok’s “Spicy Mode” allowed users to create sexualised deepfakes with simple text prompts.
“The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking,” California Attorney General Rob Bonta said.
“We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material.”
California Governor Gavin Newsom said the “vile” decision prompted him to urge the attorney general to hold the company accountable.
A coalition of 28 civil society groups submitted open letters to Apple and Google, urging them to ban Grok and X from their app stores.
Indonesia became the first country to block access to Grok entirely on Saturday, with neighbouring Malaysia following on Sunday.
India said X had removed thousands of posts and hundreds of user accounts in response to its complaints.
Britain’s Ofcom media regulator said it was opening a probe into whether X failed to comply with UK law.
France’s commissioner for children referred Grok’s generated images to French prosecutors and regulators.
An analysis of more than 20,000 Grok-generated images found more than half depicted “individuals in minimal attire”.
Most of those depicted were women, with two percent appearing to be minors.
