DiscoverCognitive CapitalEpisode #0004: Activation Functions, Bias and Neural Network Math
Episode #0004: Activation Functions, Bias and Neural Network Math

Episode #0004: Activation Functions, Bias and Neural Network Math

Update: 2024-01-01
Share

Description

In this episode, I ramble on a bit about some of the parts of neural network mathematics, particularly activation functions and bias.




1. Activation Functions: https://en.wikipedia.org/wiki/Activation_function




I also talk about a book by Jeff Heaton, Introduction to the Math of Neural Networks. It's very short and simple but a nice fast read for a quick introduction to the topic. Check it out if you're interested: https://www.amazon.de/-/en/Jeff-Heaton-ebook/dp/B00845UQL6

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Episode #0004: Activation Functions, Bias and Neural Network Math

Episode #0004: Activation Functions, Bias and Neural Network Math

John Faucett