Information commissioner launches Grok investigation over explicit deepfakes

The UK’s information commissioner has opened a formal investigation into the Grok AI chatbot over its use of personal data to produce sexualised images and video.

Last month the UK Government said it would bring in a new law to make it illegal to create non-consensual intimate images.

It followed widespread concern over the use of the AI chatbot on Elon Musk’s social media platform X (formerly Twitter) to alter images of women and children.

The Information Commissioner’s Office (ICO) today said it had opened a formal investigation into X Internet Unlimited Company and X.AI. The ICO said the reported creation of such content raised “serious concerns” under UK data protection law and presented “a risk of significant potential harm to the public”.  

William Malcolm, executive director Regulatory Risk & Innovation at the ICO, said: “The reports about Grok raise deeply troubling questions about how people’s personal data has been used to generate intimate or sexualised images without their knowledge or consent, and whether the necessary safeguards were put in place to prevent this.

“Losing control of personal data in this way can cause immediate and significant harm. This is particularly the case where children are involved. 

“Our role is to address the data protection concerns at the centre of this, while recognising that other organisations also have important responsibilities. We are working closely with Ofcom and international regulators to ensure our roles are aligned and that people’s safety and privacy are protected. We will continue to work in partnership as part of our coordinated efforts to create trust in UK digital services.”

News of the investigation came as the Paris prosecutor raided X’s offices in the city as part of an investigation into suspected offences including unlawful data extraction and complicity in the possession of child pornography. 

Meanwhile, media regulator Ofcom has set out the next stages of its investigation into X and the limitations of the Online Safety Act in relation to AI chatbots. It is currently gathering evidence to determine whether X has broken the law but is not currently investigating X.AI.

While the regulator ultimately has the power to block access to X it said this would be a “significant regulatory intervention” and not one that would be routinely made given the impact on freedom of expression.

It is against the law to share or threaten to share an intimate image of someone of any age without their consent, including AI-generated images. From Friday, it will also be unlawful to create, or request the creation of, such images. 

After being contacted by Ofcom at the start of last month, X said it had implemented safety measures including preventing Grok from allowing the editing of images of real people in revealing clothing such a bikinis. However, there is evidence that it remains possible to make such images using the chatbot.

Speaking to Labour MPs last month, Prime Minister Keir Starmer said X could lose the “right to self-regulate” if it did not tackle the issue.

“If X cannot control Grok, we will,” he said.