dolphinscheduler-sdk-python
dolphinscheduler-sdk-python copied to clipboard
apache
Apache DolphinScheduler Python API, aka PyDolphinscheduler.
when call `python script.py` will raise some log like below ```log Auth token is default token, highly recommend add a token in production, especially you deploy in public network. ```...
I can get the workflow of project through workflow.project, but I am curious about how can I find all workflows given a single project, which means I do not see...
Support Flink SQL & Flink Stream task
I pushed the tasks from YAML. How to create HIVECLI task.
## Brief Summary of The Change Define workflow without create user, queue, tenant ## Pull Request checklist I confirm that the following checklist has been completed. - [ ] Add/Change...
```python environment = Environment(name="python-numpy", config="export PYTHON_HOME=/xxx/xxx/python3") task = Python(name="123", definition="import numpy as np", environment_name=environment) ``` if `python-numpy` exist, update the environment, if not create a new environment.
For example, If I have the workspace like this: https://github.com/pytorch/examples/tree/main/word_language_model We can submit the task ```python # [start workflow] from pydolphinscheduler.core import Workflow from pydolphinscheduler.core.resource import Resource, LocalResource from pydolphinscheduler.tasks...
```python # [start workflow] from pydolphinscheduler.core import Workflow from pydolphinscheduler.core.resource import Resource from pydolphinscheduler.tasks import Shell dependence = "dependence.py" main = "main.py" with Workflow( name="multi_resources_example", # [start create_new_resources] resource_list=[ Resource(...
There are many convert function in Task class ```shell timeout timeout_flag is_cache resource_list environment_code ``` I think we can a better way to deal with it