Inference Scaling, AI Agents, and Moratoria (with Toby Ord)

Update: 2025-06-16

Description

Toby Ord is a Senior Researcher at Oxford University.

We discuss the ‘scaling paradox’, inference scaling and its implications, ways to interpret trends in the length of tasks AI agents can complete, and some unpublished thoughts on lessons from scientific moratoria for the development of AGI.

To see all our published research, visit forethought.org/research.

Comments

In Channel

Politics and Power Post-Automation (with David Duvenaud)

2025-09-2501:30:42

[Article] AI Tools for Existential Security

2025-09-1727:34

Is Gradual Disempowerment Inevitable? (with Raymond Douglas)

2025-09-0901:45:20

[Article] Intelsat as a Model for International AGI Governance

2025-09-0755:07

[Article] Will AI R&D Automation Cause a Software Intelligence Explosion?

2025-08-3101:50:40

Should AI Agents Obey Human Laws? (with Cullen O'Keefe)

2025-08-2801:23:54

[Article] AI-Enabled Coups: How a Small Group Could Use AI to Seize Power

2025-08-2602:09:32

How Can We Prevent AI-Enabled Coups? (with Tom Davidson)

2025-08-1702:13:50

Should We Aim for Flourishing Over Mere Survival? (with Will MacAskill)

2025-08-0402:54:24

AI Rights for Human Safety (with Peter Salib and Simon Goldstein)

2025-07-0901:53:37

Inference Scaling, AI Agents, and Moratoria (with Toby Ord)

2025-06-1602:55:10

AI Tools for Existential Security (with Lizka Vaintrob)

2025-04-1601:15:07

Will AI R&D Automation Cause a Software Intelligence Explosion? (with Tom Davidson)

2025-03-2601:19:50

Preparing for the Intelligence Explosion (with Will MacAskill)

2025-03-1801:51:00

Intelsat as a Model for International AGI Governance (with Rose Hadshar)

2025-03-1401:07:19

What is ForeCast?

2025-02-1700:58

00:00

#box-pro-ellipsis-175916092676478{-webkit-line-clamp:2;}Inference Scaling, AI Agents, and Moratoria (with Toby Ord)