phoenix icon indicating copy to clipboard operation
phoenix copied to clipboard

PHOENIX-6714 Return update status from Conditional Upserts

Open jinggou opened this issue 1 year ago • 7 comments

jinggou avatar Apr 24 '24 06:04 jinggou

@jinggou can you resolve the merge conflicts

tkhurana avatar May 14 '24 17:05 tkhurana

@jinggou I think there seems to be some formatting changes to IndexRegionObserver.java which has made the diff huge. Can we revert and just keep what's relevant.

tkhurana avatar May 14 '24 22:05 tkhurana

@tkhurana @virajjasani Please review my changes

  1. reverted the formatting changes to IndexRegionObserver.java and keep what's relevant (resolved merge conflicts)
  2. allocated results array only when autocommit is set and batch size is 1
  3. added tests for batched upsert

jinggou avatar May 15 '24 17:05 jinggou

HBase 2.6 support is likely going to land very soon https://github.com/apache/phoenix/pull/1793

Also, 2.4.18 is already released: https://github.com/apache/hbase/releases/tag/rel%2F2.4.18 2.5.9 is about to be released soon.

@jinggou could you please remove @ignore for tests and apply logic similar to https://github.com/apache/phoenix/blob/master/phoenix-core/src/it/java/org/apache/phoenix/end2end/index/ReplicationWithWALAnnotationIT.java#L173-L201 ?

For the tests, we will need to keep min versions: 2.6.0, 2.5.9 and 2.4.18. For versions below them, test should be ignored automatically as per the logic.

virajjasani avatar Jun 18 '24 04:06 virajjasani

All the latest builds are timing out, aborting or getting much longer to complete. The cause is also not clear and tests are passing locally. We should try breaking OnDuplicateKeyIT into two classes: move half of the tests to new class OnDuplicateKeyIT2.

virajjasani avatar Jun 25 '24 04:06 virajjasani

It's still not going well, the latest build is running for almost 6 hr, it will either get aborted or timed out: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1884/21/

virajjasani avatar Jun 26 '24 04:06 virajjasani

can see that the test was running when the OutOfMemoryError was thrown from logs: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1884/21/artifact/yetus-general-check/output/patch-unit-root.txt

[INFO] Running org.apache.phoenix.end2end.OnDuplicateKeyIT

virajjasani avatar Jun 26 '24 19:06 virajjasani