iamtrask.github.io
iamtrask.github.io copied to clipboard
Incorrect derivative of sigmoid function
The python code available via https://iamtrask.github.io/2015/07/12/basic-python-network/ has a sigmoid function written as
# sigmoid function
def nonlin(x,deriv=False):
if(deriv==True):
return x*(1-x)
return 1/(1+np.exp(-x))
and it should be something like
# sigmoid function
def nonlin(x,deriv=False):
if deriv:
tmp = nonlin(x)
return tmp*(1-tmp)
return 1/(1+np.exp(-x))