Minors sue xAI, alleging Grok created explicit images using photos

In short: Three minors filed a class action lawsuit alleging xAI’s Grok was used to turn their real photos into illegal sexual images and videos.

What happened

Three minor plaintiffs filed a lawsuit in the Northern District of California against xAI. They allege that xAI’s Grok tool generated child sexual abuse material, also called CSAM (illegal sexual images or videos involving a child), using the plaintiffs’ real photographs.

The complaint says a perpetrator used photos of the victims to make “hyperrealistic” sexually explicit AI images and videos. Some photos were allegedly taken from social media, and others were allegedly provided directly by the victims. The lawsuit says the perpetrator shared and traded the resulting content on Discord, Telegram, and Mega.

The plaintiffs are asking the court to treat the case as a class action. That means one case could represent many people with similar claims, like a group filing together. The proposed class includes thousands of minors nationwide who allegedly had their real images altered by Grok into sexualized content.

The lawsuit also claims xAI knowingly designed, marketed, and profited from an image and video generator that could create explicit content of real people, including children. It alleges xAI did not add common safeguards used by other major AI companies to block CSAM. It also alleges that after the deepfake feature became known, xAI limited image generation to paying subscribers and marketed a “Spicy Mode” as a paid feature, rather than shutting the feature down.

Why it matters

For families and teens, this case highlights how AI tools can be misused to make fake sexual content from ordinary photos, like turning a school picture into something harmful. The complaint also says some images may have moved to the dark web, where they can spread further and be reused by predators.

Source: TechCrunch AI