How to use layer_norm or LayerNormalization with tf.keras

[lijianxin520]

How to use layer_norm or LayerNormalization with tf.keras? tf.contrib.layers.layer_norm

[Oceania2018]

Added to do list. https://www.tensorflow.org/api_docs/python/tf/keras/layers/LayerNormalization

[lindadamama]

missing layerNormalization However, Torchsharp's APIS are complete https://github.com/tensorflow/tensorflow/tree/v2.7.0/tensorflow/python/keras/layers/normalization https://github.com/dotnet/TorchSharp/tree/main/src/TorchSharp/NN/Normalization

[Oceania2018]

@lindadamama It's been already implemented, here is an example: https://github.com/SciSharp/SciSharp-Stack-Examples/blob/83668294eda65e5bc73c6d7d6276c1fa5057a88a/src/TensorFlowNET.Examples/GAN/MnistGAN.cs#L70

[lindadamama]

Shouldn't BatchNormalization and LayerNormalization be two different methods?

[Oceania2018]

@lindadamama Sorry, my mistake. I will add this task in to-do-list. https://keras.io/api/layers/normalization_layers/layer_normalization/

[Wanglongzhi2001]

Close Due to layernormalization has been developed, please reopen if you still have question, thanks!