makemore icon indicating copy to clipboard operation
makemore copied to clipboard

[Suggestion] Add a note about the training of Bengio et al. MLP

Open OmriKaduri opened this issue 3 years ago • 0 comments

Hi @karpathy, thanks for that great repo!

Maybe it would be better to note in your code that while you're training by minimizing the CE loss, Bengio actually maximized the log-likelihood. I know that it is equivalent in this case (one-hot vectors as ground-truth), but that's not the case in general, so maybe better to note. Thanks!

OmriKaduri avatar Sep 27 '22 17:09 OmriKaduri