pai icon indicating copy to clipboard operation
pai copied to clipboard

[ERROR] jobEnvs is not allowed

Open edenbuaa opened this issue 6 years ago • 7 comments

PAI Version: v0.14.0 I can't find where to enable debug job in the latest version. It report 'jobEnvs' is not allowed when I try to edit the job YAML. The document is still for old version refer to https://github.com/microsoft/pai/blob/master/docs/user/troubleshooting_job.md#reserve-failed-docker-for-debugging

How to enable the debug mode in v0.14?

edenbuaa avatar Sep 09 '19 10:09 edenbuaa

image @ydye Do you have any suggestions? thanks.

edenbuaa avatar Sep 11 '19 03:09 edenbuaa

Hi @edenbuaa Current protocol not support jobEnv. For a workaround, you can add sleep 2d after your command.

If you would like to debug your job, you can ssh into the container and we provide a user guide for this: remote_develeoment

Binyang2014 avatar Sep 11 '19 05:09 Binyang2014

@Binyang2014, please update the doc accordingly.

fanyangCS avatar Sep 11 '19 05:09 fanyangCS

@Binyang2014 The sleep command may be not a good idea if usually the error occurs before sleep. What 's the plan to support this feature again?

edenbuaa avatar Sep 11 '19 06:09 edenbuaa

Sure, will consider to add this feature back. But may not add in the yarn version, will consider to add this feature in pur-k8s version.

If you want use this feature in current release, you can go to pai_master_ip/submit_v1.html, and use protocol v1 to submit such job.

Binyang2014 avatar Sep 11 '19 07:09 Binyang2014

got it, thanks.

edenbuaa avatar Sep 11 '19 07:09 edenbuaa

@Binyang2014 Is the isdebug feature ready in the k8s version?

edenbuaa avatar Dec 09 '21 04:12 edenbuaa