Listen Top Shows Blog

Facing Superintelligence (with Ben Goertzel)

Facing Superintelligence (with Ben Goertzel)

Update: 2025-05-23

Share

Description

On this episode, Ben Goertzel joins me to discuss what distinguishes the current AI boom from previous ones, important but overlooked AI research, simplicity versus complexity in the first AGI, the feasibility of alignment, benchmarks and economic impact, potential bottlenecks to superintelligence, and what humanity should do moving forward.

Timestamps:

00:00:00 Preview and intro

00:01:59 Thinking about AGI in the 1970s

00:07:28 What's different about this AI boom?

00:16:10 Former taboos about AGI

00:19:53 AI research worth revisiting

00:35:53 Will the first AGI be simple?

00:48:49 Is alignment achievable?

01:02:40 Benchmarks and economic impact

01:15:23 Bottlenecks to superintelligence

01:23:09 What should we do?

Comments

In Channel

Breaking the Intelligence Curse (with Luke Drago)

Breaking the Intelligence Curse (with Luke Drago)

2025-09-1001:09:38

What Markets Tell Us About AI Timelines (with Basil Halperin)

What Markets Tell Us About AI Timelines (with Basil Halperin)

2025-09-0101:36:10

AGI Security: How We Defend the Future (with Esben Kran)

AGI Security: How We Defend the Future (with Esben Kran)

2025-08-2201:18:21

Reasoning, Robots, and How to Prepare for AGI (with Benjamin Todd)

Reasoning, Robots, and How to Prepare for AGI (with Benjamin Todd)

2025-08-1501:27:01

From Peak Horse to Peak Human: How AI Could Replace Us (with Calum Chace)

From Peak Horse to Peak Human: How AI Could Replace Us (with Calum Chace)

2025-07-3101:37:21

How AI Could Help Overthrow Governments (with Tom Davidson)

How AI Could Help Overthrow Governments (with Tom Davidson)

2025-07-1701:53:50

What Happens After Superintelligence? (with Anders Sandberg)

What Happens After Superintelligence? (with Anders Sandberg)

2025-07-1101:44:55

Why the AI Race Ends in Disaster (with Daniel Kokotajlo)

Why the AI Race Ends in Disaster (with Daniel Kokotajlo)

2025-07-0301:10:27

Preparing for an AI Economy (with Daniel Susskind)

Preparing for an AI Economy (with Daniel Susskind)

2025-06-2701:03:38

Will AI Companies Respect Creators' Rights? (with Ed Newton-Rex)

Will AI Companies Respect Creators' Rights? (with Ed Newton-Rex)

2025-06-2001:27:15

AI Timelines and Human Psychology (with Sarah Hastings-Woodhouse)

AI Timelines and Human Psychology (with Sarah Hastings-Woodhouse)

2025-06-1301:15:50

Could Powerful AI Break Our Fragile World? (with Michael Nielsen)

Could Powerful AI Break Our Fragile World? (with Michael Nielsen)

2025-06-0601:01:29

Facing Superintelligence (with Ben Goertzel)

Facing Superintelligence (with Ben Goertzel)

2025-05-2301:32:34

Will Future AIs Be Conscious? (with Jeff Sebo)

Will Future AIs Be Conscious? (with Jeff Sebo)

2025-05-1601:34:28

Understanding AI Agents: Time Horizons, Sycophancy, and Future Risks (with Zvi Mowshowitz)

Understanding AI Agents: Time Horizons, Sycophancy, and Future Risks (with Zvi Mowshowitz)

2025-05-0901:35:10

Inside China's AI Strategy: Innovation, Diffusion, and US Relations (with Jeffrey Ding)

Inside China's AI Strategy: Innovation, Diffusion, and US Relations (with Jeffrey Ding)

2025-04-2501:02:33

How Will We Cooperate with AIs? (with Allison Duettmann)

How Will We Cooperate with AIs? (with Allison Duettmann)

2025-04-1101:36:03

Brain-like AGI and why it's Dangerous (with Steven Byrnes)

Brain-like AGI and why it's Dangerous (with Steven Byrnes)

2025-04-0401:13:14

How Close Are We to AGI? Inside Epoch's GATE Model (with Ege Erdil)

How Close Are We to AGI? Inside Epoch's GATE Model (with Ege Erdil)

2025-03-2801:34:34

Special: Defeating AI Defenses (with Nicholas Carlini and Nathan Labenz)

Special: Defeating AI Defenses (with Nicholas Carlini and Nathan Labenz)

2025-03-2102:23:13

00:00

00:00

x

Facing Superintelligence (with Ben Goertzel)

Facing Superintelligence (with Ben Goertzel)

Gus Docker