dolphinscheduler icon indicating copy to clipboard operation
dolphinscheduler copied to clipboard

[Feature][EMR Task] Amazon EMR task jobFlowDefineJson supports parameter passing functionality

Open SEZ9 opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I had searched in the issues and found no similar feature requirement.

Description

On the AWS platform, many customers use EMR to submit tasks like Spark. DolphinScheduler uses jobFlowDefineJson to define EMR task parameters, but currently does not support parameter passing from upstream tasks. Users hope to define parameters in Spark, such as date and time, by passing parameters. image

Use case

On the AWS platform, many customers use EMR to submit tasks like Spark. DolphinScheduler uses jobFlowDefineJson to define EMR task parameters, but currently does not support parameter passing from upstream tasks. Users hope to define parameters in Spark, such as date and time, by passing parameters.

Related issues

No response

Are you willing to submit a PR?

  • [x] Yes I am willing to submit a PR!

Code of Conduct

SEZ9 avatar May 10 '24 04:05 SEZ9