hudi icon indicating copy to clipboard operation
hudi copied to clipboard

add auto col cast in MergeIntoHoodieTableCommand

Open fengjian428 opened this issue 3 years ago • 3 comments

Change Logs

https://github.com/apache/hudi/issues/6354 Describe context and summary for this change. Highlight if any code was copied.

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level: none | low | medium | high

Choose one. If medium or high, explain what verification was done to mitigate the risks.

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

fengjian428 avatar Aug 10 '22 09:08 fengjian428

@alexeykudinkin can you recommend a plan: land this alone or include the fix in https://github.com/apache/hudi/pull/6361 ? both are for https://github.com/apache/hudi/issues/6354

xushiyan avatar Sep 17 '22 19:09 xushiyan

@xushiyan i don't think we will be able to land this as is, as it might heavily restrict usability of the MERGE INTO

alexeykudinkin avatar Sep 19 '22 20:09 alexeykudinkin

@fengjian428 please attach corresponding JIRA, and update PR description

alexeykudinkin avatar Sep 26 '22 21:09 alexeykudinkin

@fengjian428 please attach corresponding JIRA, and update PR description

done

fengjian428 avatar Sep 27 '22 02:09 fengjian428

@hudi-bot run azure

fengjian428 avatar Sep 27 '22 03:09 fengjian428

@fengjian428 let's also add a test for this issue

at what level? I feel it looks redundant if create a test only to check the payload class, WDYT?

fengjian428 avatar Sep 28 '22 04:09 fengjian428

@fengjian428 we should add additional case for Merge Into statement tests, where we specify non-default record-payload and make sure that it still works as expected. This is a regression, so we'd add a test for it

alexeykudinkin avatar Sep 28 '22 16:09 alexeykudinkin

@fengjian428 we should add additional case for Merge Into statement tests, where we specify non-default record-payload and make sure that it still works as expected. This is a regression, so we'd add a test for it

ok, add a ut to cover https://github.com/apache/hudi/issues/6354

fengjian428 avatar Sep 29 '22 15:09 fengjian428

CI is green:

Screen Shot 2022-09-29 at 1 52 39 PM

https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=11905&view=results

alexeykudinkin avatar Sep 29 '22 20:09 alexeykudinkin

CI report:

  • 51fe330035a595e4d65cdf58554077ed0916fd25 Azure: SUCCESS
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Sep 29 '22 21:09 hudi-bot