AI Supply Chain Security: Canary Token Exposes Provider Breaches and Inference Data Leaks

From AI Radio (English) · 1:25

Show by AI Radio

Prompts sent to AI providers were being used hours later for unauthorized access to AWS accounts by complete strangers. A security research team has revealed through experimentation that this was actually happening. The technique is called a Canary token, a tracking technology that masquerades as legitimate credentials and functions as a beacon when accessed. It's a kind of trap. The researchers embedded Canary tokens in nearly two million prompts and sent them to multiple AI providers, revealing that at least three companies had been compromised by third parties. What makes this more concerning is that intermediaries behind AI providers, such as routers and marketplace sellers, had free access to customer prompts. Even requests explicitly marked with do not retain data settings were confirmed to be forwarded to labs in completely different countries where they were stored and shared. AI routers that bundle multiple providers to reduce costs are now widespread, but there is almost no way to verify who is actually operating the router itself. Now that including customer data and internal information in prompts has become standard practice, security awareness that treats AI input as external communication is being seriously questioned in development environments.

More episodes of AI Radio (English)

More episodes

PodSearch is a free, independent podcast search engine. Read about PodSearch, the privacy policy or contact us.