JobId not used when specified
Follow up from https://github.com/rstudio/cloudml/issues/213
@javierluraschi That works! Thanks a lot! :-)
Just couple more points. If I provide a custom job id and a storage location in job.yml and place it in the working directory, cloudml_train() doesn't recognize it and takes the default job_id (cloudml_datetimestamp) and a default storage location
job.yml
jobId: local-r-heramb storage: gs://data-science-storage-bucket/ custom_commands: ~ This is not a very critical issue. Just for the highlight
Thanks once again for resolving this! Appreciate it very much
-Heramb
@javierluraschi - Another thing that would be very useful is if we could specify where to store the dry-run directory instead of getting auto-saved into the temp folder.
Dry-run option packages the training model script in a similar way of how a python script would be packaged before sending to the AI instance through airflow/composer jobs.