foundationdb icon indicating copy to clipboard operation
foundationdb copied to clipboard

Fix ConsistencyCheck_InvalidShardSize due to unfair split [release-7.3]

Open jzhou77 opened this issue 2 years ago • 10 comments

cherrypick #10066

ConsistencyCheck thinks the shard is too large and should be split. However, it is possible that the split point returned by the Storage Server is discarded due to "unfair" sizes after the split. Fix this problem by checking if this is the case in ConsistencyCheck.

20230428-210937-jzhou-93595c8410e21461

Code-Reviewer Section

The general pull request guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

  • [ ] The PR has a description, explaining both the problem and the solution.
  • [ ] The description mentions which forms of testing were done and the testing seems reasonable.
  • [ ] Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

  • [ ] This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or main if this is the youngest branch)
  • [ ] There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

jzhou77 avatar Apr 28 '23 21:04 jzhou77

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: c58c0d4ccbca8c599e13ca9434f4d95f6412ee9b
  • Duration 0:19:06
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci avatar Apr 28 '23 21:04 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: c58c0d4ccbca8c599e13ca9434f4d95f6412ee9b
  • Duration 0:20:35
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci avatar Apr 28 '23 21:04 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: c58c0d4ccbca8c599e13ca9434f4d95f6412ee9b
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Apr 28 '23 21:04 fdb-windows-ci

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

  • Commit ID: c58c0d4ccbca8c599e13ca9434f4d95f6412ee9b
  • Duration 0:28:04
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci avatar Apr 28 '23 21:04 foundationdb-ci

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: c58c0d4ccbca8c599e13ca9434f4d95f6412ee9b
  • Duration 0:32:43
  • Result: :x: FAILED
  • Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci avatar Apr 28 '23 21:04 foundationdb-ci

Result of foundationdb-pr-macos on macOS Ventura 13.x

  • Commit ID: c58c0d4ccbca8c599e13ca9434f4d95f6412ee9b
  • Duration 0:38:10
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci avatar Apr 28 '23 21:04 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 6aab667375e77d808f71cdd2a943e4124fe9fd4f
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Apr 28 '23 22:04 fdb-windows-ci

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 6aab667375e77d808f71cdd2a943e4124fe9fd4f
  • Duration 0:35:34
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci avatar Apr 28 '23 22:04 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 6aab667375e77d808f71cdd2a943e4124fe9fd4f
  • Duration 1:07:10
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci avatar Apr 28 '23 22:04 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 6aab667375e77d808f71cdd2a943e4124fe9fd4f
  • Duration 1:21:58
  • Result: :x: FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci avatar Apr 28 '23 22:04 foundationdb-ci