hudi
hudi copied to clipboard
[HUDI-7251] [WIP] Support partial schema for CDC workload
Change Logs
We pass the partial schema into write config, which will be used in HoodieAppendHandle. Here we assume
- the inputBatch contains the partial schema which is from the upstream.
- the inputBatch contains either insert, update or delete records.
Impact
Low since the partial schema equals the full schema by default.
Risk level (write none, low medium or high below)
Low.
Contributor's checklist
- [ ] Read through contributor's guide
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
CI report:
- 1698e7f7a5410b6f7c46fc21e9e73e1362e5f5ce Azure: FAILURE
Bot commands
@hudi-bot supports the following commands:-
@hudi-bot run azurere-run the last Azure build