machine-learning-book
machine-learning-book copied to clipboard
Page 365, missing negative sign in the calculation of partial derivative of activation unit with respect to z(out)
$$ \frac{\partial a_1^{(out)}}{\partial z_1^{(out)}} = \frac{\partial}{\partial z_1^{out}}\cdot \frac{1}{1+e^{z_1^{(out)}}} = ... = \left(\frac{1}{1+e^{z_1^{(out)}}}\right) \cdot \left(1-\frac{1}{1+e^{z_1^{(out)}}}\right)$$
In this equation, the exponents should have negative sign