Tony Wang

Thanks for your reply. The cluster is hadoop 3.2.2 with kerberos, and I tried spark example successfully. I tried minist-tensorflow example according to the guide, https://github.com/tony-framework/TonY/tree/master/tony-examples/mnist-tensorflow, but it failed. Do...

**cli command:** #!/usr/bin/env bash java -cp `hadoop classpath`:/data/tony-dist/tony-cli-0.5.3-uber.jar com.linkedin.tony.cli.ClusterSubmitter \ --python_venv=/data/venv/myvenv.zip \ --src_dir=/data/tony-dist/mnist-tensorflow \ --executes=mnist_distributed.py \ # relative path inside src/ --task_params="--steps 1000 --data_dir /user/test/tony/data --working_dir /user/test/tony/model" \ # You...

Got it, I have updated hadoop environment, and it reported python error as the below. **The error: ModuleNotFoundError: No module named 'contextlib'**

My package pyenv is set at ubuntu 18.04 system with anaconda according to the guide https://github.com/tony-framework/TonY/tree/master/tony-examples/mnist-tensorflow. Do you have another guide about setting up nomachine system package env to package...

I used anaconda to package virtualenv python and obtained virtualenv pyenv zip, but this pyenv zip can not work at worker nodes. Is it right method?

It worked in local machine by using "ven/bin/python " cmd line, but failed in remote worker node by submitting task with TonY script.

If pyenv is packaged by virtualenv or anaconda, does it need to activate this pyenv python environment at the worker node, such as the comand, 'venv/bin/activate' before the task start...

From v0.6.0 yarn document, there is the cmd line, "java org.apache.submarine.client.cli.Cli job run --name tf-job-001 \ ....". Where is the 'java org.apache.submarine.client.cli.Cli' implementation? I didn't find its package with Cli...

Does release v0.7 or later version support to run on yarn?

In addition, Does release-0.6.0 support hadoop 3.2.2? It reported errors when compiling the source codes of release-0.6.0 as the below.