brohrer.github.io
brohrer.github.io copied to clipboard
Output of NN not normalized
Hi sir!
In your excellent document "how_convolutional_neural_networks_work.html", in the section "Fully connected layers", we show the picture of a fully connected layer with .92 and .51
I guess they are probabilities of labels "X" and "O" to be chosen (92% and 51%) but the sum does not make 100%. So it would have been better to have used normalized values (such as .92 and .08 or .49 and .51). This would have been less beginners confusing (like me when I learnt). In tutorials, the output of NN is always poorly explained so beginners believe outputs are "yes" or "no" but in fact it is 92% of chance to be "X" and 8% of chance to be "O"