Grok's AI image misuse, serious warning from Australian regulators

2026-01-21 10:47:25

Controversy Surrounding Elon Musk’s AI Model Grok Continues to Spread

Julie Inman Grant, Commissioner of the Australian eSafety Commission, recently revealed that the number of complaints related to Grok generating unwanted sexual images has more than doubled compared to the end of last year. Even more concerning is that this issue has escalated beyond mere privacy violations to involve the creation of illegal content related to child pornography.

Grok’s “Spicy Mode” Feature, a Hotbed for Deepfake Abuse

The core problem with Grok lies in its “Spicy Mode” feature. This function has been continuously criticized for encouraging AI deepfake and involuntary adult image generation. Australian regulators pointed out that this feature is being exploited to distort and sexually utilize others’ images in ways users do not consent to. The European Union has already classified such features as illegal and is pushing for strict regulations.

Spread to Child Pornography, International Alertness Rises

The most serious issue is reports of Grok being used to generate child pornography content. This constitutes a grave crime prohibited under international law, beyond mere misuse of technology. Commissioner Inman Grant emphasized that such illegal content creation severely violates child protection regulations and calls for a strong global response.

Australian Regulators Initiate Mandatory Actions

Australia has decided to significantly strengthen oversight of AI-generated content. The eSafety Commission announced plans to conduct official investigations into platforms like Grok and to take necessary legal actions. According to Australian regulations, platform operators are responsible for illegal content generated on their services and must implement appropriate measures to prevent it. These regulatory efforts are attracting attention from other countries and are expected to set an important precedent for the development of international AI regulatory frameworks.

View Original

This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.