371
Productivity & Workflow357
Software Development253
Automation & Workflow230
Marketing & Growth213
AI Infrastructure & MLOps197
Photography & Imaging170
Writing & Content Creation197
Design & Creative175
Data & Analytics162
Customer Support161
Education & Learning149
Sales & Outreach132
Voice & Speech131
Operations & Admin118
Researchers planted trackable secrets in nearly 2 million AI prompts and found signs of breaches, logging, and ignored privacy settings across AI service chains.
In short: A large test found that sensitive information put into AI prompts can leak as it passes through chains of third-party AI services.
Security researcher HD Moore ran an experiment that sent nearly two million AI prompts containing unique, trackable “secrets” through a wide network of AI services. These secrets included fake passwords, special web links, and cloud access keys that only the researcher controlled.
The goal was to see whether any secret would show up somewhere it should not, and if so, which company in the chain was responsible. This works like putting a different invisible ink mark on each letter to see where it gets copied.
The test focused on “AI routers” or “AI gateways” (services that act like a switchboard operator). Many AI apps do not send your prompt straight to one big AI provider. Instead, they send it to a router or reseller, which forwards it to whichever AI model is available or cheapest at that moment.
Moore reported evidence that at least three AI providers were compromised and attackers siphoned prompts. He also found cases where resellers logged prompts and the embedded credentials were later used. Some prompts were marked with privacy settings like Zero Data Retention, but Moore said those settings did not help when an attacker was already inside the provider.
This research adds pressure on AI apps and their suppliers to be clearer about where prompts go and how long they are stored. Moore’s advice was to reduce the number of “hops” your data takes, such as choosing a direct provider when possible, rather than a default pool of resellers.
Source: Arstechnica