DiscoverThe TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)Neural Arithmetic Units & Experiences as an Independent ML Researcher with Andreas Madsen - #382
Neural Arithmetic Units & Experiences as an Independent ML Researcher with Andreas Madsen - #382

Neural Arithmetic Units & Experiences as an Independent ML Researcher with Andreas Madsen - #382

Update: 2020-06-111
Share

Description

Today we’re joined by Andreas Madsen, an independent researcher based in Denmark whose research focuses on developing interpretable machine learning models. 

While we caught up with Andreas to discuss his ICLR spotlight paper, “Neural Arithmetic Units,” we also spend time exploring his experience as an independent researcher. We discuss the difficulties of working with limited resources, the importance of finding peers to collaborate with, and tempering expectations of getting papers accepted to conferences -- something that might take a few tries to get right.

In his paper, Andreas notes that Neural Networks struggle to perform exact arithmetic operations over real numbers, but this can be helped with the addition of two NN components: the Neural Addition Unit (NAU), which can learn exact addition and subtraction; and the Neural Multiplication Unit (NMU) that can multiply subsets of a vector.

The complete show notes can be found at twimlai.com/talk/382.

Comments 
In Channel
loading
Download from Google Play
Download from App Store
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Neural Arithmetic Units & Experiences as an Independent ML Researcher with Andreas Madsen - #382

Neural Arithmetic Units & Experiences as an Independent ML Researcher with Andreas Madsen - #382

Sam Charrington