Zhe Wang
**This PR introduces PhysicalShard concept to Data Distribution** The feature is protected by `ENABLE_DD_PHYSICAL_SHARD`. `ENABLE_DD_PHYSICAL_SHARD` replies on `SHARD_ENCODE_LOCATION_METADATA`. Please make sure `SHARD_ENCODE_LOCATION_METADATA` is set when setting `ENABLE_DD_PHYSICAL_SHARD`. The core data...
**Introduction** AuditStorage is a functionality that serves to audit the system's data storage by checking for data consistency. It is triggered when a client requests an audit or when a...
With feature off: 20240227-191840-zhewang-6763b642320c135f compressed=True data_size=36714923 duration=24940 ended=383 fail_fast=10 max_runs=100000 pass=383 priority=100 remaining=1 day, 3:31:36 runtime=0:06:21 sanity=False started=793 submitted=20240227-191840 timeout=5400 username=zhewang With feature on: # Code-Reviewer Section The general pull...
Implemented a distributed consistency checker, called consistencycheckurgent, which is similar with the one in release-7.1 except for the persisting metadata. Did code clean up and decouple the consistencycheckurgent and the...
Replace this text with your description here... # Code-Reviewer Section The general pull request guidelines can be found [here](https://github.com/apple/foundationdb/wiki/FoundationDB-Commit-Process). Please check each of the following things and check *all* boxes...
Priority-based auditStorage is designed to audit the data consistency of risky shards in real time. Currently, the risk of a shard is simply defined as equal to the write rate...
Replace this text with your description here... # Code-Reviewer Section The general pull request guidelines can be found [here](https://github.com/apple/foundationdb/wiki/FoundationDB-Commit-Process). Please check each of the following things and check *all* boxes...
100K ValidateStorage test: 20230613-151157-zhewang-3000ecba147bee75 compressed=True data_size=34308092 duration=8302892 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=1:02:38 sanity=False started=100000 stopped=20230613-161435 submitted=20230613-151157 timeout=5400 username=zhewang 100K correctness test: 20230610-033358-zhewang-782b59fd5d816e1d compressed=True data_size=34266178 duration=6727564 ended=100000 fail=7 fail_fast=10...
Cherrypick https://github.com/apple/foundationdb/pull/11346 100K correctness test with 1 irrelevant failure: 20240502-004327-zhewang-5177db71281d373a compressed=True data_size=26926268 duration=5064278 ended=100000 fail=1 fail_fast=10 max_runs=100000 pass=99999 priority=100 remaining=0 runtime=1:08:02 sanity=False started=100000 stopped=20240502-015129 submitted=20240502-004327 timeout=5400 username=zhewang # Code-Reviewer Section...
**Design principles to make it simple and avoid error-prone:** 1. Bulk loading is managed based on KeyRange. The bulk loading UI must guarantee that a bulk loading task is running...