A smartphone showing the Grok AI chatbot as Indonesia restricts access following concerns over AI-generated deepfakes.
Indonesia has temporarily restricted access to Grok, the chatbot developed by xAI, after a wave of harmful AI-generated images began circulating online. Officials confirmed the move on Saturday, saying it was necessary to protect citizens from digital abuse.
The decision comes after Grok was found to be generating sexualized images without consent, many of which featured real people and, in some cases, minors. These images were being shared through X, the social media platform that is owned by the same company as xAI.
Indonesia’s Communications and Digital Minister, Meutya Hafid, described the content as a serious violation of human dignity and online safety. She said non-consensual deepfake content harms victims and threatens the security of people in the digital space. The ministry has also called in representatives from X to explain how the issue occurred and what steps will be taken to prevent further abuse.
Global pressure grows on xAI
Indonesia is not alone in taking action. Governments across the world are now pushing back against the rise of AI-generated sexual content. In India, the IT Ministry has ordered xAI to put safeguards in place to stop Grok from producing obscene material. In Europe, regulators have required the company to preserve all records linked to Grok, a move that may lead to a formal investigation.
In the United Kingdom, media regulator Ofcom has launched a fast-track review to see if Grok has broken online safety rules. Prime Minister Keir Starmer said he supports strong enforcement if violations are confirmed. The United States government has so far remained silent. This has drawn criticism from lawmakers, especially since xAI’s founder Elon Musk has close ties to former President Donald Trump. Several Democratic senators have urged Apple and Google to remove X from their app stores until the problem is addressed.
xAI responds as criticism mounts
xAI initially issued an apology through Grok’s official account, stating that some posts violated ethical rules and may have broken US laws related to child exploitation. The company later limited Grok’s image creation tools to paying X users. However, this change did not affect the standalone Grok app, which still allowed anyone to generate images. That raised concerns among regulators who believe stronger controls are needed across all platforms.
Elon Musk responded to criticism from the United Kingdom by claiming the government was looking for reasons to censor AI tools. His statement added more tension to an already growing global debate over how artificial intelligence should be regulated.
A wider debate over AI safety
The Grok controversy highlights a larger problem facing governments worldwide. As AI tools become more powerful, the risk of misuse increases, especially when it comes to deepfake technology.
Advocacy groups and digital safety experts have warned that without strict safeguards, AI systems can be used to create harmful and abusive content that spreads quickly online. Indonesia’s move to block Grok sends a strong message that countries are no longer willing to tolerate platforms that allow non-consensual and harmful digital material to circulate. Whether xAI can regain access in the country will depend on how quickly it improves content controls and compliance with local laws.
About The Author
