Episode #0004: Activation Functions, Bias and Neural Network Math

https://is1-ssl.mzstatic.com/image/thumb/Podcasts211/v4/51/9d/ec/519decfd-303f-cf60-4b8b-f6dc5bb3372a/mza_14194029339720616268.jpg/600x600bb.jpg

Cognitive Capital

John Faucett

6 episodes

1 week ago

Cognitive Capital is a podcast where I explore how mathematics can power sharper thinking, better decisions, and a deeper understanding of the world. Each episode is an exploration in the worlds of decision science, reasoning, risk, game theory among others, in an attempt at unpacking how abstract math models can be used to understand and impact real-world problems like war, negotiation, uncertainty, and intelligence. Whether you're a thinker, builder, strategist, or just endlessly curious, join me to learn how to model the mind—and the world—with mathematical precision.

Mathematics

Science

RSS

All content for Cognitive Capital is the property of John Faucett and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Mathematics

Science

https://d3t3ozftmdmh3i.cloudfront.net/staging/podcast_uploaded_nologo/39192791/39192791-1721563077485-2ef116c320d76.jpg

Episode #0004: Activation Functions, Bias and Neural Network Math

Cognitive Capital

19 minutes 22 seconds

1 year ago

Episode #0004: Activation Functions, Bias and Neural Network Math

In this episode, I ramble on a bit about some of the parts of neural network mathematics, particularly activation functions and bias.

1. Activation Functions: https://en.wikipedia.org/wiki/Activation_function

I also talk about a book by Jeff Heaton, Introduction to the Math of Neural Networks. It's very short and simple but a nice fast read for a quick introduction to the topic. Check it out if you're interested: https://www.amazon.de/-/en/Jeff-Heaton-ebook/dp/B00845UQL6