A new lawsuit alleges that Grok was used to create thousands of sexual images of a minor and that the platform's reporting and safety response failed to catch the scale of the abuse. Ars Technica reports that more young girls are suing X over Grok-related child sexual abuse material.
The case highlights the severe risks around generative image systems when safeguards, monitoring, and reporting are insufficient. AI image tools can multiply harm quickly if abuse detection does not work at scale.
For AI platforms, the allegations raise urgent questions about prompt monitoring, child-safety reporting, and how quickly systems must respond when users attempt illegal content generation.