Blog

I’m working through Andrej Karpathy’s awesome introduction to neural networks and the backpropagation algorithm, and am trying to differentiate the sigmoid function: $ $ \sigma(x) = \frac{1}{(1+e)^{-x}} $ $ My understanding is the quotient rule holds that given an equation $ y=\frac{t}{b}$ the derivative of the function should be: $ $ y’ = \frac{t’b –Read more

I made this short video and notebook to explain two classic goto activation functions. I’d highly appreciate constructive feedback! Video , Notebook , And images (it won’t render images on GitHub) PS – the “previous video” will be published soon… EDIT: the code is attached for your reference: # coding: utf-8 # ### Intro toRead more