bitsail icon indicating copy to clipboard operation
bitsail copied to clipboard

[BitSail][Connector] Support DDL sync in Kudu Writer.

Open BlockLiu opened this issue 3 years ago • 2 comments

Is your feature request related to a problem? Please describe

Current BitSail supports KuduWriter in connector-kudu module.

In practical use, when the upstream schema has one or more columns that target Kudu table does't have, we may want to add these columns to the Kudu Table.

So this issue requires supports such DDL sync in Kudu Writer.

Describe the solution you'd like

One can use com.bytedance.bitsail.base.extension.SchemaAlignmentable to achieve this feature.

Describe alternatives you've considered

An alternative way is that you can design your own interface and use the interface in current framework.

Additional context

N/A

BlockLiu avatar Nov 09 '22 01:11 BlockLiu

I have a question, If I use a KuduSchemaAlignment class to implement SchemaAlignmentable interface , Do I need to implement all possible ddl functions or do I just need to implement the operation of adding columns to align the schema? BecauseI think it is dangerous to delete columns or modify field type when importing data @BlockLiu @garyli1019

beyond-up avatar Mar 10 '23 02:03 beyond-up

please assign to me please!

beyond-up avatar Mar 10 '23 07:03 beyond-up