DiscoverLinear DigressionsRevisiting Biased Word Embeddings
Revisiting Biased Word Embeddings

Revisiting Biased Word Embeddings

Update: 2019-06-242
Share

Description

The topic of bias in word embeddings gets yet another pass this week. It all started a few years ago, when an analogy task performed on Word2Vec embeddings showed some indications of gender bias around professions (as well as other forms of social bias getting reproduced in the algorithm’s embeddings). We covered the topic again a while later, covering methods for de-biasing embeddings to counteract this effect. And now we’re back, with a second pass on the original Word2Vec analogy task, but where the researchers deconstructed the “rules” of the analogies themselves and came to an interesting discovery: the bias seems to be, at least in part, an artifact of the analogy construction method. Intrigued? So were we…

Relevant link:
https://arxiv.org/abs/1905.09866
Comments 
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Revisiting Biased Word Embeddings

Revisiting Biased Word Embeddings

Ben Jaffe and Katie Malone