Updating ppc64el wheel to latest version (currently: 2.2.0)

[jonglezb]

Hi,

Expected Behavior

The ppc64el build at https://powerci.osuosl.org/job/TensorFlow2_PPC64LE_GPU_Release_Build/ should provide the latest stable version.

Actual Behavior

The version provided is 2.2.0, while the latest version is 2.3.1.

Details

I am using the ppc64el wheel linked above on a POWER8 system: it works fine, but it's still at 2.2.0.

The main issue I have is installation time, because it depends on a specific version of scipy. When installing the tensorflow wheel, pip needs to build this version of scipy, which takes about 20 minutes. The dependency on scipy is not actually required and got removed in 2.3.1: https://github.com/tensorflow/tensorflow/pull/41867

So, a 2.3.1 ppc64el wheel would make installation significantly faster.

Building a newer wheel

I used the script https://github.com/tensorflow/build/blob/master/ci_environments/ppc64le/gpu_build.sh together with the ibmcom/tensorflow-ppc64le:gpu-devel-manylinux2014 docker image and I managed to build tensorflow 2.3.1 with it.

There was one issue with some versions of python in the container:

/opt/python/cp37-cp37/bin/python3.7: error while loading shared libraries: libcrypt.so.2: cannot open shared object file: No such file or directory

I could fix that by adding /usr/local/lib/ to $LD_LIBRARY_PATH (most notably in the .tf_configure.bazelrc file generated by the script).