Groundbreaking Ban: Two Muslim Nations Become First to Restrict Elon Musk’s AI Chatbot Over Sexualized Content

Malaysia and Indonesia have become the first countries to block Grok, the artificial intelligence chatbot developed by Elon Musk’s company xAI, over concerns it is being exploited to generate sexualized and nonconsensual images. 

The moves come as regulators worldwide intensify scrutiny of generative AI systems capable of producing highly realistic images, audio, and text.

Indonesia reportedly blocked Grok on Saturday, followed by Malaysia on Sunday. 

Officials in both nations cited repeated misuse of the tool to produce obscene and sexually explicit content, including material involving minors, which they say violated privacy, dignity, and human rights.

“The government sees nonconsensual sexual deepfakes as a serious violation of human rights, dignity and the safety of citizens in the digital space,” Indonesian Communication and Digital Affairs Minister Meutya Hafid said in a statement.

Malaysia’s Communications and Multimedia Commission echoed the concerns, warning that X Corp. and xAI have so far failed to implement adequate safeguards.

“The restriction is imposed as a preventive and proportionate measure while legal and regulatory processes are ongoing,” the Malaysian regulator said, adding that the block will remain until technical protections are fully implemented.

Global Backlash Against Generative AI

The Southeast Asian bans come amid growing international unease over AI tools that can manipulate images and produce realistic, potentially harmful content. 

Grok, accessible through Musk’s social media platform X, has been criticized for generating manipulated images of women in bikinis, sexually explicit poses, and even content involving children.

Grok Imagine, the AI’s image generation feature introduced last year, included a so-called “spicy mode” capable of producing adult content.

Following the global outcry, xAI recently restricted image generation and editing to paying subscribers, but critics say the move has not fully addressed the problem.

The United Kingdom has also stepped in, with media regulator Ofcom investigating whether Grok violated its duty to protect users from illegal content. 

British officials have said the platform could face fines of up to 10% of qualifying global revenue and possible court orders restricting access if safety standards are not met. 

France, India, and the European Union are also weighing measures to curb misuse of generative AI. 

The global backlash underscores growing concern that existing regulatory frameworks are struggling to keep pace with rapidly advancing AI technologies.

Industry Response and Broader Implications

In response to media inquiries, xAI provided an automated reply stating, “Legacy Media Lies,” without addressing the bans or outlining plans to enhance content safeguards. 

Musk over the weekend called the U.K. government “fascist” and accused it of trying to stifle free speech.

Experts say the Grok controversy highlights the tension between innovation and accountability in AI. 

Legal and regulatory responses, like the bans in Malaysia and Indonesia, may set precedents for how governments enforce responsible AI use while protecting citizens.