Meta's CM3leon π¨ // ChatGPT Isn't Getting Dumber π€ // Linear Complexity Speech Recognition π£οΈ
Description
CM3leon, a new generative model for text and images that is more efficient and state-of-the-art. OpenAI researcher Jason Wei is also featured, offering an "Ask Me Anything" document on AI research. Additionally, Sumformer, a linear-complexity alternative to self-attention for speech recognition, and DreamTeacher, a self-supervised feature representation learning framework that uses generative networks for pre-training downstream image backbones, are discussed.
Contact:Β Β sergi@earkind.com
Timestamps:
00:34 Introduction
02:16 Β Introducing CM3leon, a more efficient, state-of-the-art generative model for text and images
03:40 Β OpenAI product leader denies claims GPT-4 has gotten βlazier and dumberβ
05:12 Β Jason Wei (OpenAI Researcher) tweets
06:04 Fake sponsor
07:54 Β Sumformer: A Linear-Complexity Alternative to Self-Attention for Speech Recognition
09:05 Β NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis
10:19 Β DreamTeacher: Pretraining Image Backbones with Deep Generative Models
12:15 Outro




