Joe Yearsley
Joe Yearsley
What version of TF are you using? All declared variables under the scope should be set to resource variables. Maybe set all variables to be resource variables, is br_count a...
Could you try defining the class outside the function and only use the instance in the function. I.e move Conv2D class instantiation outside of `_x` func. And if that’s doesn’t...
Can you share your script?
I managed to fix by removing all `.handle` calls in that function using tf 1.10
https://github.com/joeyearsley/efficient_densenet_tensorflow Made using gradient checkpointing like the gpleiss repo does.
https://github.com/joeyearsley/efficient_densenet_tensorflow Made using gradient checkpointing like the gpleiss repo does.
If I clone and build from source it works correctly, I'll open a ticket in poetry as well in case it is an issue with their installer
Having spoken to the poetry team they believe the issue lies in Horovod not being compliant with PEP-517/518, is this correct? If so, are there any plans to resolve this?
The best I can say is it might be, however on my system I've got TensorFlow already installed and poetry seems to be resolving to install it before horovod. So...
Note the outstanding error seems to be a CI problem: >java.io.IOException: Failed to run image 'tensorflowppc64le/tensorflow-ppc64le:osuosl-ubi7-horovod-opence1.4.1-py3.9-ppc64le'. Error: docker: Error response from daemon: failed to create task for container: failed to...