Malaysia and Indonesia have taken action to block Grok, an AI chatbot developed by Elon Musk’s company xAI, amid concerns over its misuse to create sexually explicit and unauthorized images. The decision comes as authorities worldwide raise alarms about the potential misuse of generative AI tools capable of producing realistic content and the inadequacy of current safeguards.
Grok, accessible through Musk’s social media platform X, has faced criticism for generating manipulated images, including those depicting women in suggestive poses, as well as content involving minors. While Grok recently limited image generation and editing for paying users following a global outcry over sexualized deepfakes, critics argue that this action did not fully address the issue.
Authorities in Malaysia and Indonesia highlighted the failure of existing controls to prevent the dissemination of fake pornographic content, particularly concerning women and minors. Indonesia’s Communication and Digital Affairs Minister, Meutya Hafid, emphasized the importance of protecting individuals from non-consensual sexual deepfakes, citing concerns about privacy violations and psychological harm.
In response to the concerns raised, Indonesia temporarily blocked access to Grok, followed by Malaysia. The Malaysian Communications and Multimedia Commission stated that repeated misuse of Grok to produce obscene and sexually explicit manipulated images led to the decision to restrict access. The regulator noted that demands for stronger safeguards from X Corp. and xAI primarily relied on user reporting mechanisms, prompting the temporary ban until more effective protections are established.
Grok, introduced in 2023 and offered for free on X, allows users to engage with the chatbot on the platform and create posts. The addition of the image generator feature, Grok Imagine, including an adult content mode, has attracted scrutiny not only in Southeast Asia but also in regions like the European Union, the United Kingdom, India, and France.
In the United Kingdom, the media regulator Ofcom launched an investigation into Grok’s compliance with its obligations to prevent illegal content dissemination. Concerns were raised about Grok-generated images potentially constituting child sexual abuse material. Meanwhile, Canada has not considered banning X, with AI Minister Evan Solomon affirming ongoing discussions around the deepfake issue.
Overall, the actions taken by Malaysia and Indonesia represent a response to the growing concerns surrounding the misuse of AI technology for creating harmful and inappropriate content, prompting a reevaluation of safeguards and regulations in the digital space.