Challenges in Augmenting Large Language Models with Private Data
From Google TechTalks · 1:04:59
Show by Google TechTalks
A Google TechTalk, presented by Ashwinee Panda, 2024-05-01ABSTRACT: LLMs are making first contact with more data than ever before, opening up new attack vectors against LLM systems. We propose a new practical data extraction attack that we call "neural phishing" (ICLR 2024). This attack enables an adversary to target and extract PII from a model trained on user data without needing specific knowledge of the PII they wish to extract. Our attack is made possible by the few-shot learning capability of LLMs, but this capability also enables defenses. We propose Differentially Private In-Context Learning (ICLR 2024), a framework for coordinating independent LLM agents to answer user queries under DP. We first introduce new methods for obtaining consensus across potentially disagreeing LLM agents, and then explore the privacy-utility tradeoff of different DP mechanisms as applied to these new methods. We anticipate that further LLM improvements will continue to unlock both stronger adversaries and more robust systems.Uploaded 20-05-24Speaker: Ashwinee Panda (Princeton University)
More episodes of Google TechTalks
More episodes
- Threat Models for Memorization: Privacy, Copyright, and Everything In-Between
- Technology Assisted Reading Acquisition: Children Acquiring Literacy Naturally
- sex on the internet, the realities of porn, sexual privacy,
- Privacy Auditing of Large Language Models
- The Limits and Possibilities of One Run Auditing
- PhotoTechEDU Day 29: Photographing VR Panoramas
- Privacy Ripple Effects from Adding or Removing Personal Information in Language Model Training
- Inside VMware Fusion
- Java Posse Episode 100 (Live Special)
- Cascading Adversarial Bias from Injection to Distillation in Language Models
PodSearch is a free, independent podcast search engine. Read about PodSearch, the privacy policy or contact us.