Francois Chollet, Mike Knoop - LLMs won’t lead to AGI - $1,000,000 Prize to find true solution
2Description
Here is my conversation with Francois Chollet and Mike Knoop on the $1 million ARC-AGI Prize they're launching today.
I did a bunch of socratic grilling throughout, but Francois’s arguments about why LLMs won’t lead to AGI are very interesting and worth thinking through.
It was really fun discussing/debating the cruxes. Enjoy!
Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here.
Timestamps
(00:00:00 ) – The ARC benchmark
(00:11:10 ) – Why LLMs struggle with ARC
(00:19:00 ) – Skill vs intelligence
(00:27:55 ) - Do we need “AGI” to automate most jobs?
(00:48:28 ) – Future of AI progress: deep learning + program synthesis
(01:00:40 ) – How Mike Knoop got nerd-sniped by ARC
(01:08:37 ) – Million $ ARC Prize
(01:10:33 ) – Resisting benchmark saturation
(01:18:08 ) – ARC scores on frontier vs open source models
(01:26:19 ) – Possible solutions to ARC Prize
Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
![Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]](https://substackcdn.com/feed/podcast/69345/post/140840711/e4de14078e8cffb24660faa969829362.jpg "Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]")
![Will scaling work? [Narration]](https://substackcdn.com/feed/podcast/69345/post/140840266/05a86be7f4b61d2bdf484bbf5ea3c9c3.jpg "Will scaling work? [Narration]")
United States
