“AIs will greatly change engineering in AI companies well before AGI” by Ryan Greenblatt
Description
Subtitle: AIs that speed up engineering by 2x wouldn't accelerate AI progress that much.
In response to my recent post arguing against above-trend progress from better RL environments, yet another argument for short(er) AGI timelines was raised to me:
Sure, at the current rate of progress, it would take a while (e.g. 5 years) to reach AIs that can automate research engineering within AI companies while being cheap and fast (superhuman coder). But we'll get large increases in the rate of AI progress well before superhuman coder due to AIs accelerating AI R&D. Probably we'll see big enough accelerations to really cut down on timelines to superhuman coder once AIs can somewhat reliably complete tasks that take top human research engineers 8 hours. After all, such AIs would probably be capable enough to greatly change research engineering in AI companies.
I'm skeptical of this argument: I think that [...]
---
Outline:
(03:59 ) AI progress speed-ups dont seem large enough
(08:45 ) Interpolating between now and superhuman coder doesnt indicate large speed-ups within 2 years
(13:34 ) What about speedups from mechanisms other than accelerating engineering?
(14:53 ) Other reasons to expect very short timelines
(15:11 ) Implications of a several year period prior to full automation of AI R&D where research engineering is greatly changed
(21:35 ) Appendix: sanity check of engineering speed-up
(23:30 ) Appendix: How do speed-ups to engineering translate to overall AI progress speed-ups?
---
First published:
September 9th, 2025
Source:
https://blog.redwoodresearch.org/p/ais-will-greatly-change-engineering
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
United States
