chainstorage icon indicating copy to clipboard operation
chainstorage copied to clipboard
verified publisher icon coinbase

Modernized ChainStorage Sync: Enable Chainstorage consuming ChainNode/ChainStorage block as backfill source

Open leozc opened this issue 2 years ago • 2 comments

  1. ChainNode as data source: Unlike normal node providers, Chainnode uses header to capture security token (yes, safer!) but currently Chainstorage doesn't seem to support this way to authenticate with a block provider.
  2. ChainStorage as data source: Enable ChainStorage use another ChainStorage Blocks to sync can be 100x of the syncing performance (Assume 100 trx for each block)

Cc @jiezhang #P1

leozc avatar Nov 09 '23 06:11 leozc

Replicator workflow POC: backfilling from another chainstorage: #91

bestmike007 avatar Feb 20 '24 07:02 bestmike007

Improve replicator workflow by introducing mini batches and continue workflow as new to prevent timeout: https://github.com/coinbase/chainstorage/pull/94

bestmike007 avatar Feb 23 '24 17:02 bestmike007