A.I. Safety Goes Mainstream + a ‘Hard Fork’ Exit AMA

Key takeaways

• Former Anthropic and OpenAI researcher Jacob Coxon's public resignation post, accusing both companies of "racing straight to self-improving superintelligence and gambling with our lives," set off a chain reaction of insiders publicly agreeing, including former colleague Evan Hubinger stating a greater than 10% chance AI could kill everyone—a number the hosts note is considered relatively optimistic inside the labs but landed as shocking to the general public.
• Dario Amodei published a 3,800-word essay, "We Must Pace the Frontier," calling for a coordinated global AI slowdown and announcing Anthropic will embed independent evaluators with employee-level access inside the company to monitor for dangerous capabilities, similar to bank examiners; Sam Altman, Elon Musk, and Demis Hassabis all voiced similar support despite their companies' rivalries.
• The hosts argue this moment matters because it's happening while only a handful of labs have frontier-level resources and expertise; acting now, before the technology becomes cheap and widely distributed to "six or seven knuckleheads in some random country," is far more effective than waiting for a catastrophe.
• Despite industry alarm, political response has split along predictable lines: Trump and many Republicans dismiss the concerns, while over 100 House Democrats are pushing to stay in session to pass bipartisan AI safeguards, though passage looks unlikely given the administration's stance and Congress's poor track record on tech regulation.
• Casey pushes back on the idea that existing product liability law is sufficient, noting Meta's history of being sued for billions without changing its behavior, and argues genuinely new legal frameworks are needed for autonomous AI systems that can act and potentially commit harm without human intervention.
• In the AMA, the hosts confirm Hard Fork is ending as their show but continuing as a Times franchise with new hosts, while Kevin and Casey launch a new AI-focused podcast called Machine Gods with NPR, debuting as a trailer now and full episodes starting October 19th, with radio distribution beginning early next year.

Notable moments

• "They are racing straight to self-improving super intelligence and gambling with our lives"; Jacob Coxon's resignation post that kicked off the whole news cycle.
• Casey compares the industry's tone shift to disaster-movie logic: "this past week or two really does feel like the part in the movie where humanity kind of bands together to save itself," invoking Armageddon.
• Kevin admits real relief that AI-lab leaders are finally saying publicly what they'd long said privately, calling it a rare case of "an industry coming to Washington and saying, please slow us down."
• A listener audio message reveals two fans, Scott and Karen, met at a Hard Fork live show and are now a couple; Kevin offers to officiate the wedding on the spot.
• Casey recounts meeting Kevin at a book party, joking, "pre-Hard Fork, Kevin was not somebody I would call if I was having an emotional crisis... at this point he's the first person I call."
• Discussing their favorite Hard Fork moment, Casey describes seeing hundreds of listeners wearing neon green hats at the first Hard Fork Live and nearly getting choked up.
• The hosts close with their signature sign-off, "we'll see you down the dusty trail," before a lengthy credits roll thanking the production team by name.

Time saved: 1 hour, 25 minutes.