Laurent El Shafey
Laurent El Shafey
Are you able to build using the provided build.sh script? https://github.com/tensorflow/lingvo/blob/master/lingvo/jax/pip_package/build.sh This sets several environment variables and flags, and it is hard for me to infer, which one you may...
Nvm, I could reproduce your issue after modifying the script.
Heads up that I have a fix (pending review) that will hopefully land Tuesday morning PDT.
This should be fixed if you sync after https://github.com/tensorflow/lingvo/commit/fe60d03c9716d1e0c87462b1e92c5ee9b39f0b87 Also make sure to update your docker build with the latest optax-shampoo (v0.0.5).
I think I know the issue. I should have warned you about this. Could you try to just run python3 and check the default version / import clu? My intuition...
I'm unable to reproduce internally :( I'm wondering if the external docker image is somehow different. I will try to reproduce starting from the OSS version.
Could you update which model name you've used? (probably not `lm.ptb.PTBCharTransformerSmallSgd`)
My TF versions for python3.7 are exactly the same as yours. Otherwise, it's definitely not the main issue. But just for the records, we didn't open source configs on PTB...
I think lingvo 0.9.0 was Pip packaged with `Requires-Dist: tensorflow (==2.5.0)`. Would you be able to use lingvo 0.10.0 instead, which includes `Requires-Dist: tensorflow (~=2.6.0)`?