“GPT-6.2 Astra and Sol: The System Card” by Zvi
From LessWrong posts by zvi · 39:42
Show by zvi
We have to stop meeting like this. Alas, we will keep meeting like this. It is time, once again, to do the reading. As per usual, I will focus on things to the extent they are new and important. There are a lot of things that need to be in the system card in case something goes wrong, but that look exactly the way you would expect. I did my best to skip those. I continue to be on vacation. I am aware that via Claude there is now a claimed Lean proof of the Reimann Hypothesis and will cover that next week. Astra 6.2 Self-Portrait Table of Contents Safety Overview (1). Internal Deployment (1.2). Preparedness Assessment (2). Biological Threats (2.1.1). Cyber Threats (2.1.2). AI Self-Improvement Threats (2.1.3). OpenAI Epoch Capabilities Index (OECI). Safeguards (2.2). AI Self-Improvement Threat Modeling (2.2.1.3). Safety Training and Evaluation (2.2.2). Jailbreak Robustness (2.2.3 and 2.2.6). Realtime Model Safeguards (2.2.4). Distillation Safeguards (2.2.5). Security Controls (2.2.9). Model Safety and Behavior (3). Alignment and Monitorability (4). Don’t Help Peer (4.1.5). Verbalized Metagaming and [...] ---Outline:(00:58) Safety Overview (1)(03:47) Internal Deployment (1.2)(04:02) Preparedness Assessment (2)(05:06) Biological Threats (2.1.1)(07:06) Cyber Threats (2.1.2)(08:05) AI Self-Improvement Threats (2.1.3)(10:41) OpenAI Epoch Capabilities Index (OECI)(11:46) Safeguards (2.2)(13:06) AI Self-Improvement Threat Modeling (2.2.1.3)(16:41) Safety Training and Evaluation (2.2.2)(17:36) Jailbreak Robustness (2.2.3 and 2.2.6)(20:00) Realtime Model Safeguards (2.2.4)(20:15) Distillation Safeguards (2.2.5)(20:55) Security Controls (2.2.9)(23:57) Model Safety and Behavior (3)(24:38) Alignment and Monitorability (4)(27:41) Don't Help Peer (4.1.5)(28:11) Verbalized Metagaming and Oversight Gaming (4.1.6)(30:31) Misaligned! (As Found By UK AISI) (4.1.7.1)(34:16) Astra is Hard to Monitor (4.2) --- First published: November 21st, 2026 Source: https://www.lesswrong.com/posts/7Skw6caJxPrBDetCC/gpt-6-2-astra-and-sol-the-system-card --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
More episodes of LessWrong posts by zvi
More episodes
- “AI #195: Opening Bell” by Zvi
- “Quickly, There’s No Time” by Zvi
- “Jensen Huang Really Liked Selling China Advanced AI Chips” by Zvi
- “Fable 5.2 is the New Bazooka” by Zvi
- “Jensen Huang Resigns After Having Another Affair In Addition to the Chinese Spy” by Zvi
- “AI #194: Spy Versus Guy” by Zvi
- “Fable and Mythos 5.2: The System Card” by Zvi
- “Nvidia CEO Jensen Huang Had an Affair With a Chinese Spy” by Zvi
- “AI R&D Is Accelerating Towards Potential RSI in 2027” by Zvi
- “GPT-6 Astra Covertly Underperforms on Safety Research Tasks” by Zvi
PodSearch is a free, independent podcast search engine. Read about PodSearch, the privacy policy or contact us.