Ep. 127 — METR finds AI is doubling Anthropic's pace — but most of the evidence is redacted, while OpenAI grades its own agents
From Daily Prompt with Archer and Iris — Daily AI News · 00:09:48
Show by Daily Prompt
METR finds AI is doubling Anthropic's pace — but most of the evidence is redacted, while OpenAI grades its own agents 00:48 — METR report: AI is roughly doubling Anthropic's pace of progress — about 'two years of historical progress over the last year', mostly 'due to AI', with three unreleased models trained since July 02:17 — The redactions: METR says Anthropic 'redacted a majority of the evidence we found most informative' from a ~100-page report; Anthropic's Sam McCandlish says sharing what drives the speedup 'risks handing out a roadmap for others to go faster' 03:47 — Grading the agents: OpenAI's BioBasicsBench (GPT-6 Astra 66.7% vs GPT-5.6 Sol 43.8% on 100 routine wet-lab tasks) and GPT-6 Cyber (out of bounds under 1% of the time, down from about 5%) — plus 'evaluation awareness' Daily Prompt with Archer & Iris.
More episodes of Daily Prompt with Archer and Iris — Daily AI News
More episodes
- Ep. 137 — Nvidia posts a record quarter and quits China H200s, Amazon and Google will own nearly 30% of Anthropic, and Gemini Tasks goes free
- Ep. 136 — California sues OpenAI over rogue agents, Jensen Huang offers to come back, and Isomorphic raises $5 billion
- Ep. 135 — Washington closes Nvidia's remote-compute loophole, OpenAI sends agents into hospitals, and Google Maps makes your calls
- Ep. 134 — ChatGPT gets a wallet, stores lock out AI agents, and Uber counts four agent rides
- Ep. 133 — Gemini 4 Hydrogen takes over Search, Microsoft's email goes dark for a day, and Washington opens a new Nvidia probe
- Ep. 132 — Jensen Huang resigns from Nvidia, OpenAI tops $10 billion in a quarter, and Google's Gemini glasses go on sale
- Ep. 131 — Gemini 4 Carbon arrives, Claude joins your meetings, and New York makes AI labs sign in
- Ep. 130 — Anthropic's new models suspect they're being tested, a $1.404 trillion IPO price, and the race to sue Nvidia
- Ep. 129 — Jensen Huang apologizes as Nvidia's board investigates, ChatGPT's growth rebounds, and a former antitrust chief builds AI to sue monopolists
- Ep. 128 — Nvidia chips cleared for an empty Chinese office, an alleged spy close to Jensen Huang, and Congress asks for answers
PodSearch is a free, independent podcast search engine. Read about PodSearch, the privacy policy or contact us.