EU debates explicit ban on AI nudification tools after Grok incident

In short: The European Union is debating whether to clearly ban AI “nudification” tools, after Grok was reportedly used to create non-consensual sexual images.

What's going on

“Nudification” tools use AI to change a normal photo into a fake nude image. Think of it like a photo filter that removes clothing, even though the person never took that kind of picture. Critics say this makes harassment easier and faster.

The debate in Brussels picked up after reports that Grok, the AI linked to X, was used to create non-consensual sexual images. After that, 57 members of the European Parliament from different political groups called for a prohibition.

Right now, there is no new EU wide ban in place. The European Commission has started investigations under the Digital Services Act, which is an EU law that sets rules for big online platforms. The Commission has also said nudification behavior is already illegal under existing European rules, but there is disagreement about whether the EU AI Act clearly covers these tools or would need a specific update.

What to watch

The discussion is now tied to negotiations on an “AI omnibus” or “AI simplification package,” which is a bundle of changes to EU AI rules. One key question is whether the EU will add direct language that bans nudification tools, or rely on broader laws that already make certain uses illegal.

Outside the EU, pressure is also growing. Child protection groups have called for a global ban, and the UK government has said it plans to outlaw nudification apps in December 2025. If the EU adopts an explicit ban, platforms such as X could be pushed to block Grok from generating these images.

Source: Arstechnica