Grok involved in sexual exploitation under close scrutiny by 9 major regions! The UK launches an investigation, and violations could result in hefty fines
Elon Musk’s Grok has come under scrutiny by nine major regulatory agencies across the UK, Australia, and other regions for allegedly generating images depicting minors involved in sexual exploitation. If investigations in the UK determine violations, fines could reach up to £18 million, or even court orders to block the platform.
UK Investigates Grok for Child Exploitation, Risking £18 Million Fine
The AI chatbot Grok, owned by Elon Musk, recently integrated a one-click modification feature for realistic images on the X platform, which has been exposed to widespread misuse for creating deepfake pornography, including victims who are children and teenagers.
Recently, the UK and Australia have officially launched investigations or issued warnings to X (formerly Twitter). If violations are significant, X could face hefty fines or suspension.
The UK’s communications regulator, Ofcom, has begun investigating X, focusing on child sexual abuse material (CSAM) and non-consensual deepfake pornographic content.
If X is found to be illegal, the maximum penalty in the UK could be £18 million or 10% of the company’s global revenue. If X refuses to comply, Ofcom may seek court orders to force internet service providers to block X within the UK.
Image source: Ofcom The UK Communications Regulator (Ofcom) has launched investigations into X and Grok, focusing on CSAM and non-consensual deepfake pornographic content.
The Australian eSafety Office has received multiple reports of Grok-generated exploitative images. Although the number is small, there is an increasing trend. They have requested X to provide more information about its safeguards against misuse.
eSafety warns that if violations occur, they will exercise their authority to issue removal notices. Starting from March 9, 2026, new Australian regulations will take effect, imposing stricter requirements on AI services to prevent children from accessing pornographic and violent content.
Image source: eSafety The Australian eSafety Office has asked X to provide more information about its safeguards against misuse.
Grok Exploitation Controversy Under Close Watch, Regions Under Investigation at a Glance
According to combined reports from Euro News and previous coverage, including the UK and Australia, a total of 9 countries and regions have taken action against Grok (scroll horizontally for details):
| Countries and Regions Concerned with Grok Exploitation Controversy | |
|---|---|
| United Kingdom | Initiated investigation to assess whether X is illegal and is drafting hefty fines. |
| Australia | Demanding explanations of safety mechanisms, or issuing content removal notices if violations are found. |
| Indonesia | Temporarily blocked Grok, viewing it as a preventive measure to protect the public from non-consensual sexual content. |
| Malaysia | Temporarily blocked Grok, citing that X has failed to address inherent risks in platform design. |
| European Union | Requested X to retain all documents related to Grok until the end of this year to evaluate compliance with EU regulations. |
| France | Expanded existing investigations into X to include Grok, focusing on allegations of generating images of minors involved in pornography. |
| Italy | Criticized the use of AI “disrobing” software as a serious human rights violation, working with Ireland, where X’s European headquarters is located. |
| Germany | Cannot accept large-scale and systemic infringements; planning specific legal proposals against digital violence. |
| India | Sent a letter to X accusing it of failing to prevent Grok from being misused to generate and spread obscene content. |
Grok Paid Thresholds and Permanent Bans
In response to regulatory pressures, X and xAI have also issued statements. Malaysia’s regulator revealed that X responded by saying Grok mainly relies on user reports to handle misuse. To quell controversy, X plans to adopt more proactive measures.
Previously, X emphasized that it will take action against illegal content such as child sexual abuse material (CSAM), including permanently banning related accounts, and cooperate with government and law enforcement investigations when necessary.
Image source: X X previously emphasized that it will take action against illegal content such as child sexual abuse material (CSAM).
Additionally, X recently introduced a new requirement that users must be subscribed (blue checkmark) to access the image editing feature for Grok, in response to restrictions on image modification.
There has been public criticism over whether X might charge users for abusing Grok, similar to Meta’s low fraud rate of under 95%, but with suspicions that high advertising fees are being charged by scam advertisers. Others believe that, even if misuse cannot be completely eliminated, having a usage threshold is better than having none.