India Warns X Over AI-Driven Content Violations

India’s digital ecosystem is evolving rapidly, with AI-driven platforms offering innovation while also raising serious questions around responsibility. As generative technology grows, the line between creativity and misuse is becoming increasingly blurred.

Platforms are now under pressure to balance free expression with safeguards against harm. This challenge has intensified as AI tools are being misused to generate and spread harmful content.

The Ministry of Electronics and Information Technology has written to X’s Chief Compliance Officer, flagging lapses in statutory due diligence. The letter cites violations under the IT Act, 2000, and IT Rules, 2021.

According to MeitY, Grok, the AI service developed by xAI and integrated with X, is being misused. The platform is allegedly hosting, generating, or sharing obscene, nude, indecent, and sexually explicit content.

The letter highlights that such content often targets women and children through fake accounts and synthetic images. Officials warned that this misuse normalises harassment and seriously undermines privacy.

MeitY has called for immediate corrective steps, including stronger prompt controls and stricter user enforcement. The ministry stressed that platforms must act swiftly to prevent further harm.

X has been asked to submit a detailed Action Taken Report within 72 hours. This report must outline content removals, account suspensions, and internal governance reviews related to Grok.

Failure to comply could result in the loss of safe harbour protections. It may also attract penalties under cyber laws and child safety regulations.

While X has faced regulatory scrutiny in the past, this development signals a broader shift. Indian authorities appear keen to introduce proactive AI guardrails before stricter regulations are enforced.

Experts believe stronger platform accountability can curb misuse without slowing technological progress. The focus, they say, must remain on responsible innovation backed by clear safeguards.