Ilya Sutskever Calls Peak Data and the End of Pretraining
Update: 2024-12-17
Description
At a recent conference appearance, SSI founder (and former OpenAI leader) Ilya Sutskever claimed that we had reached peak data and that the era of pre-training as a scaling method had come to a close. NLW explores the implications. Plus, NotebookLM releases an enterprise edition.
Brought to you by:
Vanta - Simplify compliance - https://vanta.com/nlw
The AI Daily Brief helps you understand the most important news and discussions in AI.
Subscribe to the podcast version of The AI Daily Brief wherever you listen: https://pod.link/1680633614
Subscribe to the newsletter: https://aidailybrief.beehiiv.com/
Join our Discord: https://bit.ly/aibreakdown
Comments
Top Podcasts
The Best New Comedy Podcast Right Now – June 2024The Best News Podcast Right Now – June 2024The Best New Business Podcast Right Now – June 2024The Best New Sports Podcast Right Now – June 2024The Best New True Crime Podcast Right Now – June 2024The Best New Joe Rogan Experience Podcast Right Now – June 20The Best New Dan Bongino Show Podcast Right Now – June 20The Best New Mark Levin Podcast – June 2024
In Channel