Tommy Mulc
Results
2
issues of
Tommy Mulc
It looks like the [default initialization scheme](https://github.com/tensorflow/tensorflow/blob/r1.4/tensorflow/python/ops/variable_scope.py#L844) with `tf.get_variable` is *uniform* Glorot , but the paper uses [He's *Gaussian*](https://www.cv-foundation.org/openaccess/content_iccv_2015/papers/He_Delving_Deep_into_ICCV_2015_paper.pdf).
Two things you may want to add: 1. Teacher forcing for RNNs (very common in practice). With a cheatsheet, you won't be able to cover everything, and this may just...