Grok restricts image generation after backlash over sexualised AI content
text_fields
Grok, the artificial intelligence tool owned by Elon Musk, has disabled its image creation and editing features for most users following widespread criticism over its use to produce sexualised and violent imagery.
The change comes after Musk faced threats of fines, regulatory action, and reports of a possible ban on X in the UK.
The image generation function is now limited to paying subscribers, according to a post from the official @Grok account on X, which said image generation and editing are currently restricted to subscribers.
The tool had been widely used to manipulate images of women, including removing clothing and placing them in sexualised positions.
By limiting access to paying users, X now holds identifying and payment information for those who continue to use the feature, allowing misuse to be traced.
However, concerns remain.
While the public Grok account on X has had its image generation capabilities heavily curtailed, users have reported that a separate Grok app, which does not publicly share images, still allows non-paying users to generate sexualised imagery of women and children.
Research cited by the Guardian found Grok had been used to create nonconsensual pornographic videos of women, as well as images depicting women being shot and killed. Separate research by Paris-based non-profit AI Forensics identified around 800 images and videos produced through the Grok Imagine app that contained pornographic or sexually violent content.
UK Prime Minister Keir Starmer warned on Wednesday that strong action could be taken against X. He described the spread of AI-generated sexual imagery as disgraceful and disgusting, and said the communications regulator Ofcom had full government backing to act. Under the Online Safety Act, Ofcom can seek court orders to block services in the UK and impose fines of up to 10 percent of a company’s global turnover.
Labour MP Jess Asato said restricting access was a step forward but criticised the decision to keep the feature available to paying users, calling the continued creation of such imagery digital sexual assault.