Call us now 01926 402 498
News
Grok AI faces backlash for creating deepfakes
X has restricted Grok AI after X users used it to undress women and children in images – without their consent.
AI Restrictions Follow Deepfake Concerns
The social media platform X has restricted its AI chatbot Grok, which can edit images of real people, in countries where creating sexualised images without consent is illegal. This change follows widespread reports that the tool was being used to generate images of women and children, including girls aged 11 to 13, undressed and sexualised.
The Internet Watch Foundation (IWF) discovered image-based abuse of children created using Grok on dark web forums. While some images are classified as less severe under UK law, the charity warns that AI tools like Grok risk bringing sexualised imagery of children into the mainstream, making exploitation more accessible and widespread.
The Impact on Survivors
Non-consensual AI-generated sexual imagery has a serious impact on survivors of sexual abuse. Images that place someone in sexualised scenarios without their consent cause distress. Leaving individuals feeling violated, unsafe, and reduced to a sexual object.
“While it wasn’t me that was in states of undress, it looked like me and it felt like me and it felt as violating as if someone had actually posted a nude or a bikini picture of me.”
Samantha Smith, speaking out after Grok AI created deepfakes of her.
This type of abuse compounds existing trauma, reinforcing fear and distrust in online spaces. Victims may struggle to engage with social platforms or support services if they fear their image could be misused, and the proliferation of these tools normalises exploitation in ways that can harm wider communities.
The Need for Action
Safeline calls on technology companies to act urgently to prevent harm. Legal safeguards and investigations by Ofcom and the UK government are important, but platforms must proactively remove illegal content, enforce policies against misuse, and implement safeguards to protect survivors.
AI tools that allow the creation of sexualised content without consent are harmful. They are a new form of abuse. Immediate action is needed to safeguard users and uphold the dignity of all individuals online.
Support for Survivors
Safeline provides confidential support to anyone affected by sexual abuse, including non-consensual AI-generated sexual content. Support and guidance are available at Safeline’s support page.
Stay up to date with Safeline’s work by following us on Social Media:
