flink-cdc icon indicating copy to clipboard operation
flink-cdc copied to clipboard
verified publisher icon apache

[FLINK-35713][common] Support set parallelism in source and sink

Open ChaomingZhangCN opened this issue 1 year ago • 7 comments

https://issues.apache.org/jira/browse/FLINK-35713

ChaomingZhangCN avatar Jan 23 '25 09:01 ChaomingZhangCN

@yuxiqian I found that the PR-3438 has been closed, could you please take a look?

ChaomingZhangCN avatar Mar 21 '25 05:03 ChaomingZhangCN

ping @leonardBang

ChaomingZhangCN avatar Apr 21 '25 09:04 ChaomingZhangCN

@ChaomingZhangCN Could you rebase this PR to latest master branch as it bumped junit version to junit5 for all tests?

leonardBang avatar Apr 21 '25 09:04 leonardBang

Minor suggestion: shall we pick MySqlToPaimonE2eITCase and FlinkParallelizedPipelineITCase to be executed with different source / sink parallelism? I believe they could cover most parallelism-aware operators (flush event alignment, 2-PC sinks, and schema operators).

yuxiqian avatar Apr 21 '25 10:04 yuxiqian

CI failed...

leonardBang avatar Apr 25 '25 07:04 leonardBang

@leonardBang PTAL~

ChaomingZhangCN avatar May 27 '25 03:05 ChaomingZhangCN

@ChaomingZhangCN Could you fix the conflicts?

leonardBang avatar Jun 05 '25 01:06 leonardBang