hudi icon indicating copy to clipboard operation
hudi copied to clipboard

[HUDI-7251] [WIP] Support partial schema for CDC workload

Open linliu-code opened this issue 2 years ago • 1 comments

Change Logs

We pass the partial schema into write config, which will be used in HoodieAppendHandle. Here we assume

  1. the inputBatch contains the partial schema which is from the upstream.
  2. the inputBatch contains either insert, update or delete records.

Impact

Low since the partial schema equals the full schema by default.

Risk level (write none, low medium or high below)

Low.

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

linliu-code avatar Jan 09 '24 00:01 linliu-code

CI report:

  • 1698e7f7a5410b6f7c46fc21e9e73e1362e5f5ce Azure: FAILURE
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Jan 09 '24 04:01 hudi-bot