3: VICReg
Update: 2022-03-21
Description
Todays paper: VICReg (https://arxiv.org/abs/2105.04906)
Summary of the paper
VICReg prevents representation collapse using a mixture of variance, invariance and covariance when calculating the loss. It does not require negative samples and achieves great performance on downstream tasks.
Highlights of discussion
- The VICReg architecture (Figure 1)
- Sensitivity to hyperparameters (Table 7)
- Top 5 metric usefulness
Comments
In Channel
Download from Google Play
Download from App Store
United States00:00
00:00
x
