The Economist · The Intelligence Briefing
Podcast debate: Alex Hern & The Economist technology desk

AI Existential Risk & Mitigation Simulator

If it’s higher than effectively zero, it’s probably too high.” — Alex Hern, on the existential stakes of frontier AI systems and the non-linear tail risks of accelerating unverified compute.

Catastrophic Tail Risk Probability Curve

Tail Risk Density
Target Tolerance
Horizontal axis: Log Severity Scale (Local Failure → Civilisation-Ending Catastrophe). Red shaded region represents calculated existential tail mass.
COMPUTED TAIL RISK
0.04%
P(Existential Failure)
TARGET THRESHOLD
0.10%
Hern tolerance max
GOVERNANCE INDEX
88/100
Mitigation rigor
SAFETY MARGIN ASSESSMENT
Managed within safety tolerance

Maintains margin below existential threshold per Alex Hern's 'effectively zero' benchmark.

Policy Levers & Compute Controls

Direct Manipulation
4.5x/yr
Scaling rate of FLOPs applied to training next-generation frontier weights.
85%
Formal interpretability proofs, red-teaming rigor, and containment guarantees.
0.10% (0.001)
Alex Hern's 'effectively zero' benchmark demands ≤ 0.10% threshold.
Enforces training hardware ceiling > 10^26 FLOPs
Independent state-backed evaluation before public deployment
POLICY BENCHMARKS & PRESETS

The Intelligence Policy Analysis & Mechanism

As explored in The Economist’s “The Intelligence” podcast, treating existential risk from frontier AI systems as an ordinary acceptable commercial externality collapses under asymmetric payoff structures. Alex Hern argues that unlike industrial or aviation risks where a 1% or 0.1% failure rate is offset by localized recovery, catastrophic systemic risk cannot be negotiated:

The “Effectively Zero” Mandate

When failure mode corresponds to irreversible civilizational loss or autonomous disempowerment, expected loss diverges. Any tolerance greater than near-zero constitutes unhedged catastrophic speculation.

Frontier Compute Compounding

Training cluster expansion (scaling upwards by 4x to 10x compute per iteration) exponentially increases latent autonomy vectors. Without symmetric verification gains, tail probability fattens rapidly.

Institutional Mitigation Lag

Hardware-level verification and compute governance agreements remain the only levers with proven stopping power before unaligned models achieve self-improvement escape velocity.

Sources & Reference: Based on discussions broadcast on The Economist’s “The Intelligence” podcast, featuring technology journalist Alex Hern discussing AI existential threats and regulatory thresholds. Verified context captured September 2026.
Enjoy this tool? Build your own with Super