foundationdb icon indicating copy to clipboard operation
foundationdb copied to clipboard
verified publisher icon apple

Include tenant and metacluster metadata in backups

Open sfc-gh-abeamon opened this issue 3 years ago • 15 comments

Update backup and restore (except parallel restore) to include system key ranges needed for tenants. Also re-enables simulated backup tests with tenants, with the exception of parallel restore tests.

Code-Reviewer Section

The general pull request guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

  • [ ] The PR has a description, explaining both the problem and the solution.
  • [ ] The description mentions which forms of testing were done and the testing seems reasonable.
  • [ ] Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

  • [ ] This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or main if this is the youngest branch)
  • [ ] There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

sfc-gh-abeamon avatar Sep 16 '22 22:09 sfc-gh-abeamon

Doxense CI Report for Windows 10

  • Commit ID: f1238d2c9a92af801614a41873065ef438d16520
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 16 '22 23:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: f1238d2c9a92af801614a41873065ef438d16520
  • Duration 1:01:05
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 16 '22 23:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 6f7147080a1fd75c13e9facd8576da969e833598
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 17 '22 00:09 fdb-windows-ci

Result of foundationdb-pr-macos on macOS BigSur 11.5.2

  • Commit ID: 6f7147080a1fd75c13e9facd8576da969e833598
  • Duration 0:48:58
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 17 '22 00:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 6f7147080a1fd75c13e9facd8576da969e833598
  • Duration 1:22:48
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 17 '22 01:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: f1238d2c9a92af801614a41873065ef438d16520
  • Duration 2:47:26
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 17 '22 01:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 6f7147080a1fd75c13e9facd8576da969e833598
  • Duration 2:46:27
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 17 '22 02:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: fe5836ac036a2d449291c06c857058326da54ad7
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 20 '22 16:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: fe5836ac036a2d449291c06c857058326da54ad7
  • Duration 1:13:49
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 20 '22 17:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: fe5836ac036a2d449291c06c857058326da54ad7
  • Duration 2:51:50
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 20 '22 19:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 3e2684c974d3011f3710b37eb044a20189d73913
  • Duration 0:10:28
  • Result: :x: FAILED
  • Error: reference not found for primary source and source version 3e2684c974d3011f3710b37eb044a20189d73913
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 22 '22 17:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 3e2684c974d3011f3710b37eb044a20189d73913
  • Duration 0:59:19
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 22 '22 17:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: a7c200b16cb05f5d9a7af39c3ba8c35058592cc9
  • Duration 0:50:42
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 22 '22 19:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: a7c200b16cb05f5d9a7af39c3ba8c35058592cc9
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 22 '22 19:09 fdb-windows-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: a7c200b16cb05f5d9a7af39c3ba8c35058592cc9
  • Duration 2:09:21
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 22 '22 20:09 foundationdb-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: c682848a190d3fc84bebed7be5d3e3c85748aa1b
  • Duration 0:01:35
  • Result: :x: FAILED
  • Error: Service role arn:aws:iam::034006644693:role/service-role/FDB-Development-Foundatio-FoundationdbPullRequestB-6D7JNN5I2JZC does not allow AWS CodeBuild to create Amazon CloudWatch Logs log streams for build arn:aws:codebuild:us-west-2:034006644693:build/foundationdb-pr:242bbe5b-8c9b-4a40-818d-f0433f5ae183. Error message: User: arn:aws:sts::034006644693:assumed-role/FDB-Development-Foundatio-FoundationdbPullRequestB-6D7JNN5I2JZC/AWSCodeBuild-242bbe5b-8c9b-4a40-818d-f0433f5ae183 is not authorized to perform: logs:CreateLogStream on resource: arn:aws:logs:us-west-2:034006644693:log-group:/aws/codebuild/foundationdb/foundationdb-pr:log-stream:242bbe5b-8c9b-4a40-818d-f0433f5ae183 because no identity-based policy allows the logs:CreateLogStream action
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 27 '22 22:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: c682848a190d3fc84bebed7be5d3e3c85748aa1b
  • Duration 0:11:44
  • Result: :x: FAILED
  • Error: reference not found for primary source and source version c682848a190d3fc84bebed7be5d3e3c85748aa1b
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 27 '22 22:09 foundationdb-ci

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 54e78a3c6eec9f069935e06e144f1466d76d91ce
  • Duration 0:10:32
  • Result: :x: FAILED
  • Error: reference not found for primary source and source version 54e78a3c6eec9f069935e06e144f1466d76d91ce
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 27 '22 22:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 54e78a3c6eec9f069935e06e144f1466d76d91ce
  • Duration 0:11:27
  • Result: :x: FAILED
  • Error: reference not found for primary source and source version 54e78a3c6eec9f069935e06e144f1466d76d91ce
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 27 '22 22:09 foundationdb-ci

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 8cd235c35fa21849c33f41991286be9cf93aa743
  • Duration 0:17:41
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 27 '22 22:09 foundationdb-ci

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 3353103d9d81091074a266c972e7b1e0789a4014
  • Duration 0:16:34
  • Result: :x: FAILED
  • Error: Error while executing command: ninja -v -C build_output -j ${NPROC} all packages strip_targets. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 27 '22 22:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 3353103d9d81091074a266c972e7b1e0789a4014
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 27 '22 22:09 fdb-windows-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 3353103d9d81091074a266c972e7b1e0789a4014
  • Duration 0:23:07
  • Result: :x: FAILED
  • Error: Error while executing command: docker build --label "org.foundationdb.version=${FDB_VERSION}" --label "org.foundationdb.build_date=${BUILD_DATE}" --label "org.foundationdb.commit=${COMMIT_SHA}" --progress plain --build-arg FDB_VERSION="${FDB_VERSION}" --build-arg FDB_LIBRARY_VERSIONS="${FDB_VERSION}" --build-arg FDB_WEBSITE="${FDB_WEBSITE}" --tag foundationdb/base:${FDB_VERSION}-${COMMIT_SHA} --file Dockerfile --target base .. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 27 '22 22:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 8cd235c35fa21849c33f41991286be9cf93aa743
  • Duration 2:04:15
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 28 '22 00:09 foundationdb-ci

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 6efe0523e4aad099e2a022b3773d5b1b9b8804a0
  • Duration 0:07:34
  • Result: :x: FAILED
  • Error: Error while executing command: aws eks --region us-west-2 update-kubeconfig --name foundationdb-dev --role-arn ${EKS_ROLE}. Reason: exit status 255
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 28 '22 16:09 foundationdb-ci

Doxense CI Report for Windows 10

  • Commit ID: 6efe0523e4aad099e2a022b3773d5b1b9b8804a0
  • Result: :heavy_check_mark: SUCCEEDED
  • Build Logs (available for 30 days)

fdb-windows-ci avatar Sep 28 '22 17:09 fdb-windows-ci

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 6efe0523e4aad099e2a022b3773d5b1b9b8804a0
  • Duration 1:49:43
  • Result: :white_check_mark: SUCCEEDED
  • Error: N/A
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 28 '22 18:09 foundationdb-ci

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 6efe0523e4aad099e2a022b3773d5b1b9b8804a0
  • Duration 2:04:12
  • Result: :x: FAILED
  • Error: Error while executing command: if $(grep -q -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log); then echo "TESTS FAILED SEE THESE LOGS:"; echo ; grep -l -- "--- FAIL:" ${CODEBUILD_SRC_DIR}/fdb-kubernetes-tests/logs/*.log; exit 1; fi. Reason: exit status 1
  • Build Logs (available for 30 days)
  • Build Artifact (available for 30 days)

foundationdb-ci avatar Sep 28 '22 18:09 foundationdb-ci