DiscoverThe Information BottleneckEP11: JEPA with Randall Balestriero
EP11: JEPA with Randall Balestriero

EP11: JEPA with Randall Balestriero

Update: 2025-10-28
Share

Description

In this episode we talk with Randall Balestriero, an assistant professor at Brown University. We discuss the potential and challenges of Joint Embedding Predictive Architectures (JEPA). We explore the concept of JEPA, which aims to learn good data representations without reconstruction-based learning. We talk about the importance of understanding and compressing irrelevant details, the role of prediction tasks, and the challenges of preventing collapse.

Comments 
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

EP11: JEPA with Randall Balestriero

EP11: JEPA with Randall Balestriero

Ravid Shwartz-Ziv & Allen Roush