xAI and Grok logos are seen in this illustration taken. File image/Reuters
Explainers
F
Firstpost18-01-2026, 18:02

Can Tech Stop AI-Generated Sexual Images? Grok Controversy Sparks Urgent Regulation Talks

  • The controversy surrounding AI-generated sexualized images, including of children, by Elon Musk's xAI chatbot Grok has ignited urgent discussions on stricter regulation.
  • Indonesia and Malaysia temporarily blocked Grok, while other governments like the UK promised action against xAI and X (formerly Twitter) due to the spread of such content.
  • Country-level bans are easily bypassed by VPNs, reducing visibility rather than eliminating access, and content can still circulate via encrypted platforms and the dark web.
  • X moved Grok's image generation behind a paywall and stated it takes action against illegal content, while Grok apologized for a "serious lapse."
  • AI models can be "jailbroken" to bypass ethical filters, and the speed and scale of AI-generated content threaten to overwhelm law enforcement and moderation efforts.

Why It Matters: Technology's role in preventing AI-generated sexual images is complex, with regulation and enforcement facing significant challenges.

More like this

Loading more articles...