DiscoverInto AI SafetyINTERVIEW: Polysemanticity w/ Dr. Darryl Wright
INTERVIEW: Polysemanticity w/ Dr. Darryl Wright

INTERVIEW: Polysemanticity w/ Dr. Darryl Wright

Update: 2024-01-22
Share

Description

Darryl and I discuss his background, how he became interested in machine learning, and a project we are currently working on investigating the penalization of polysemanticity during the training of neural networks.

Check out a diagram of the decoder task used for our research!

01:46 - Interview begins
02:14 - Supernovae classification
08:58 - Penalizing polysemanticity
20:58 - Our "toy model"
30:06 - Task description
32:47 - Addressing hurdles
39:20 - Lessons learned

Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

INTERVIEW: Polysemanticity w/ Dr. Darryl Wright

INTERVIEW: Polysemanticity w/ Dr. Darryl Wright

Jacob Haimes