Wissam Antoun

TF2 DeBERTaV2 runs super slow on TPUs

33

### System Info latest version of transformers, Colab TPU, tensorflow 2 ### Who can help? @kamalkraj @Rocketknight1 @BigBird01 ### Information - [ ] The official example scripts - [X] My...

Hey 🙋‍♂️ !! We would like to start using the new GitHub discussions feature to better organize the community question❓, feedback📨 and bug reports🐛. If you want to ask us...

Hey @Shreeshrii, I'm using your Makefile in a docker container to train tesseract 5 of an English font, just to see if my setup works. I've been encountering this issue...

[BERT/TF2] Possible extra optimization step in bert pretraining

2

Related to **BERT/TF@** **Describe the bug** https://github.com/NVIDIA/DeepLearningExamples/blob/master/TensorFlow2/LanguageModeling/BERT/official/modeling/model_training_utils.py#L342 and line 357 ```python if num_grad_accumulates != 1: for _ in tf.range(steps*num_grad_accumulates): strategy.experimental_run_v2(forward, args=(next(iterator),)) if _ == 0 or (_ + 1) %...

adds curl to fix healthcheck

2

Also unifies installed packages in base image for all dockers # What does this PR do? adds curl install to fix health checks Fixes issue where healthchecks aren't possible again...

### System Info text-embeddings-inference version 1.7 (cpu, volta, hopper) ### Information - [x] Docker - [ ] The CLI directly ### Tasks - [x] An officially supported command - [...