bert-for-tf2
bert-for-tf2 copied to clipboard
kpe
A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.
/usr/local/lib/python3.6/dist-packages/bert/model.py:80 call * output = self.encoders_layer(embedding_output, mask=mask, training=training) /usr/local/lib/python3.6/dist-packages/keras/engine/base_layer.py:1030 __call__ ** self._maybe_build(inputs) /usr/local/lib/python3.6/dist-packages/keras/engine/base_layer.py:2659 _maybe_build self.build(input_shapes) # pylint:disable=not-callable /usr/local/lib/python3.6/dist-packages/bert/transformer.py:209 build self.input_spec = keras.layers.InputSpec(shape=input_shape) /usr/local/lib/python3.6/dist-packages/keras/engine/base_layer.py:2777 __setattr__ super(tf.__internal__.tracking.AutoTrackable, self).__setattr__(name, value) # pylint: disable=bad-super-call...
Replaced "from tensorflow.python import keras" with "from tensorflow import keras".
Hello, I am using tensor flow 2.3.0 with python 3.7 and I am getting some issues. The Count of weights not found in the checkpoint was: [196] where it was...
I am using the TF-2.5-vanilla Conda environment. It has tensorflow2.5 installed using the command `pip install tensorflow==2.5.0` . I have installed your bert using `pip install bert-for-tf2`. I have written...
How would you approach named-entity recognition with this library?
Implement the Pooler layer from the BERT model architecture, which creates a pooled feature vector using the first token from the output sequence. In many of the online blogs and...
AttributeError: module 'bert' has no attribute 'Layer' In embeddings.py should be "from bert.layer import Layer" not "import bert" as bert is a directory that reside in a directory bert-for-tf2. Here...
hi, I am using this script to generate albert saved model which is capativble with `tf serving` since i genrated model , the input is { "instances":[ {"inputs": ["你好么"]} ]...
It seems that the package dose not support mixed precision training, since the Embedding layer needs add operating with output and embedding parameters, which dtype are 'float32' and 'float16' leading...
Hi, i already have a global idea of how the BERT model works, but i want to understand the code (line by line), unfortunatly the code has almost no comments,...
