X said on Jan. 14 it was imposing limits on Grok’s image editing capabilities, after countries around the world opened investigations and threatened lawsuits over the use of the built-in artificial intelligence (AI) chatbot to generate sexually explicit images.
The Safety unit said that image creation and editing via the Grok account is now only available for paid subscribers. The unit said this was to add an “extra layer of protection by helping to ensure that individuals who attempt to abuse the Grok account to violate the law or our policies can be held accountable.”
“We now geoblock the ability of all users to generate images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in X in those jurisdictions where it’s illegal,” the statement said.
Grok can be used in X either by tagging the Grok account in a message and typing a request, or by clicking the Grok icon to open a chat dialogue box, similar in appearance to OpenAI’s ChatGPT.
The Safety unit said it was working to add additional safeguards and was taking “swift and decisive action” to remove illegal or violating content, suspending offending accounts, and working with authorities and law enforcement in relevant countries, where necessary.
“We remain committed to making X a safe platform for everyone and continue to have zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content,” X said in the statement.
California Investigation
The move came after several authorities from around the world launched investigations into or lawsuits against Elon Musk’s social media platform.He said the social media platform had become a “breeding ground” for spreading “nonconsensual sexually explicit AI deepfakes.”
Bonta said the state would demand answers from xAI, Musk’s AI development company, about its plans “to stop the creation & spread of this content.”
UK, Malaysia Investigations
On Jan. 12, the UK’s communications regulator opened an investigation into X, alleging that it broke British law by failing to comply with duties to protect people from illegal content in the UK.“If so, that is welcome, but we are not going to back down. X must act. We will take the necessary measures. We will strengthen existing laws and prepare for legislation if it needs to go further, and Ofcom will continue its independent investigation,” Starmer said.

The Malaysian Communications and Multimedia Commission said it had identified misuse of Grok “to generate and disseminate harmful content,” including sexually explicit and nonconsensual manipulated images. The commission said Musk’s companies can be held liable under Malaysian law even though the content was generated by users.







