Relevance for UPSC: GS III (Science & Technology, Internal Security), GS II (Governance); Source: Indian Express; Rest of World

Context

The misuse of Grok, an artificial intelligence chatbot integrated with X (formerly Twitter), to generate obscene and non-consensual images has drawn regulatory attention in India and abroad. The episode exposes gaps in artificial intelligence governance, platform accountability, and user protection, especially in the context of generative technologies.

Core Issue

• Users manipulated image-generation prompts to create sexually explicit and non-consensual visuals, including of women and minors.
• Raises concerns related to deepfakes, digital sexual exploitation, privacy violations, and inadequate safety guardrails in artificial intelligence systems.

India’s Regulatory Response

• The Ministry of Electronics and Information Technology cautioned the platform about compliance failures, warning of withdrawal of safe harbour protection.
• Reinforces the obligation of intermediaries to proactively prevent and remove unlawful content.

Indian Regulatory Frameworks

• Information Technology Act, 2000 – intermediary liability framework.
• Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021 – content moderation and grievance redressal.
• Bharatiya Nyaya Sanhita, 2023 – provisions on obscenity and sexual exploitation.

Conclusion

The Grok episode highlights the urgency of artificial intelligence–specific safeguards, stronger intermediary accountability, and effective use of regulatory mechanisms like SAHAYOG to ensure digital innovation does not compromise user dignity and safety.