The safeguarding minister in the UK has urged law enforcement to actively pursue individuals using Elon Musk’s Grok platform to create harmful deepfake images of children. Jess Phillips expressed her concerns to The Mirror, emphasizing the need for accountability as outrage mounts over the situation. Grok’s AI service has faced criticism for generating explicit images of individuals, including minors, without their consent.
Phillips strongly condemned the existence of such features, highlighting the detrimental impact on lives due to abuse. Recently, Grok, previously known as Twitter, announced that deepfake creation would become a premium service limited to paying users. Phillips dismissed this move as insufficient, emphasizing the urgency for comprehensive action.
She emphasized the necessity for law enforcement to vigorously pursue those responsible for producing or disseminating AI-generated images for malicious purposes. Phillips denounced the decision to restrict Grok’s image generator to paid users as inadequate, stressing that tools enabling the creation of degrading non-consensual content should not be tolerated.
Furthermore, Phillips underscored the legal obligation of social media platforms to promptly remove such content, warning of potential hefty fines by regulator Ofcom for non-compliance. She urged Ofcom to use its authority without hesitation in addressing issues related to child sexual abuse, emphasizing the severe consequences for individuals involved in creating, possessing, or distributing AI-generated explicit content.
Celebrities like Maya Jama have joined the call for platforms to cease generating unauthorized images of them. The UK government is pushing for new legislation that would penalize the production, possession, and distribution of harmful AI images of children with up to five years in prison.
In addition, Labour’s strategy against violence towards women and girls commits to outlawing apps that produce deepfake images without consent. Phillips announced that legislation has been enacted to criminalize the creation of intimate deepfake images without consent, with plans to enforce it promptly.
The situation escalated as Ofcom recently raised concerns with Musk’s X and xAI regarding sexualized images of children generated by Grok. Musk acknowledged the lapses in safeguards and assured that illegal content produced using Grok would face consequences.
The government and regulatory bodies are intensifying efforts to combat the proliferation of harmful deepfake content, emphasizing the need for platforms like X to take decisive action. Musk’s acknowledgment of the issue and commitment to enforcing consequences for illicit content generated through Grok indicate a step towards addressing the pressing concerns surrounding deepfake technology.