dolphinscheduler-sdk-python icon indicating copy to clipboard operation
dolphinscheduler-sdk-python copied to clipboard

[feat] Auto create not exist environment config when submit workflow

Open jieguangzhou opened this issue 3 years ago • 1 comments

environment = Environment(name="python-numpy", config="export PYTHON_HOME=/xxx/xxx/python3")
task = Python(name="123", definition="import numpy as np", environment_name=environment)

if python-numpy exist, update the environment, if not create a new environment.

jieguangzhou avatar Dec 21 '22 06:12 jieguangzhou

The environment worker group is required, I do know whether is good to create environment in python code or in CLI, we used to create user, tenant, queue in python code, but it is a bad idea because, when some workflow define change the tenant and user, will cause some permission error, so in https://github.com/apache/dolphinscheduler-sdk-python/pull/40 I try to create user, tenant, queue via CLI, and workflow define just use username

zhongjiajie avatar Dec 21 '22 14:12 zhongjiajie