Ruoming Pang
Ruoming Pang
Thank you so much, Laurent. Let me try it.
Strangely now I ran into the "No module named 'clu'" error again: ``` # bazel run -c opt \ > lingvo/jax:main -- \ > --model=lm.ptb.PTBCharTransformerSmallSgd \ > --job_log_dir=/tmp/jax_log_dir/exp01 --alsologtostderr Extracting...
Before my run, my docker was running out of space, so I ran ``` docker system prune --all ```
Thanks! Indeed. It's 3.6 and update-alternative solves the problem. Can we update the docker file to avoid 3.6? ``` # python3 --version Python 3.6.13 ``` After that, I'm running into...
Thanks for looking into this, Laurent! It's actually lm.ptb.PTBCharTransformerSmallSgd: ```bash % bazel run -c opt lingvo/jax:main -- \ --model=lm.ptb.PTBCharTransformerSmallSgd \ --job_log_dir=/tmp/jax_log_dir/exp01 --alsologtostderr ```
I noticed that lingvo/jax/pip_package/build.Dockerfile does not specify dependency versions explicitly, so maybe we are using different versions of TF? I see: ``` tensorflow 2.8.0 tensorflow-datasets 4.5.2 tensorflow-hub 0.12.0 tensorflow-io-gcs-filesystem 0.24.0...
A gentle ping on this PR. Currently `tfds build librispeech` does not work.
Do we still need this PR?
> @ruomingp Hey, could you please help me with this check? How do I pass this check? It seems a bug in the Dockerfile? ``` => ERROR [ci 1/3] RUN...
> > > Increases memory efficiency > > > > > > Do you have measurements on how DATA improves memory efficiency? Thanks. > > > > Increases memory efficiency...