#192 - ChatGPT Pro, Amazon Nova, GenFM, Llama 3.3, Genie 2
Update: 2024-12-16
Description
Our 192nd episode with a summary and discussion of last week's* big AI news!
*and sometimes last last week's
Note: this one was recorded on 12/04 , so the news is a bit outdated...
Hosted by Andrey Kurenkov and Jeremie Harris.
Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.
Sponsors:
- The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.
- The AI safety book “Uncontrollable" which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today!
In this episode:
- OpenAI launches a $200 ChatGPT Pro subscription with advanced capabilities, while Amazon unveils cost-effective Nova multimodal models at the re:Invent conference.
- Meta releases LLAMA 3.3 70B model, showing significant gains through post-training techniques, and Alibaba introduces QWQ, a reasoning model rivaling OpenAI's O1.
- Amazon collaborates with Anthropic on a massive AI supercomputer project, and Black Forest Labs eyes a $200 million funding round for growth in AI tools.
- New research from DeepMind's Genie 2 generates interactive 3D worlds from text and images, progressing AI's understanding of world models and interactive environments.
If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.
Timestamps + Links:
- (00:00:00 ) Intro / Banter
- (00:02:34 ) Sponsor Break
- Tools & Apps
- (00:04:19 ) OpenAI confirms new $200 monthly subscription, which includes its o1 reasoning model
- (00:10:40 ) Amazon announces Nova, a new family of multimodal AI models
- (00:17:13 ) ElevenLabs launches GenFM to turn user content into AI-powered podcasts
- (00:20:21 ) Google’s new generative AI video model is now available
- Applications & Business
- (00:23:56 ) Elon Musk files for injunction to halt OpenAI’s transition to a for-profit
- (00:29:40 ) Amazon Is Building a Mega AI Supercomputer With Anthropic
- (00:34:15 ) It Sounds an Awful Lot Like OpenAI Is Adding Ads to ChatGPT
- (00:38:23 ) A16z in Talks to Lead $200 Million Round in Black Forest Labs, Startup Behind AI Images on Grok
- (00:41:10 ) Bezos Backs AI Chipmaker Vying With Nvidia at $2.6 Billion Value
- Projects & Open Source
- (00:45:25 ) Meta unveils a new, more efficient Llama model
- (00:50:00 ) Alibaba releases an ‘open’ challenger to OpenAI’s o1 reasoning model
- (00:55:21 ) DeMo: Decoupled Momentum Optimization
- (00:57:01 ) PRIME Intellect Releases INTELLECT-1 (Instruct + Base): The First 10B Parameter Language Model Collaboratively Trained Across the Globe
- (01:03:03 ) Tencent Launches HunyuanVideo, an Open-Source AI Video Model
- Research & Advancements
- (01:09:23 ) DeepMind’s Genie 2 can generate interactive worlds that look like video games
- (01:16:43 ) Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding
- (01:20:40 ) Densing Law of LLMs
- (01:25:59 ) Monet: Mixture of Monosemantic Experts for Transformers
- Policy & Safety
- (01:30:56 ) Commerce Strengthens Export Controls to Restrict China’s Capability to Produce Advanced Semiconductors for Military Applications
- (01:37:33 ) China retaliates against latest US chip restrictions
- (01:40:52 ) OpenAI Is Working With Anduril to Supply the US Military With AI
- (01:43:24 ) On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback
- (01:47:52 ) AI Safety Researcher Quits OpenAI, Saying Its Trajectory Alarms Her
- (01:51:52 ) Meta Claims AI Content Was Less than 1% of Election Misinformation
- (01:55:05 ) Outro
Comments
Top Podcasts
The Best New Comedy Podcast Right Now – June 2024The Best News Podcast Right Now – June 2024The Best New Business Podcast Right Now – June 2024The Best New Sports Podcast Right Now – June 2024The Best New True Crime Podcast Right Now – June 2024The Best New Joe Rogan Experience Podcast Right Now – June 20The Best New Dan Bongino Show Podcast Right Now – June 20The Best New Mark Levin Podcast – June 2024
In Channel