spruned icon indicating copy to clipboard operation
spruned copied to clipboard

txindex: reduce its size down to 20% 🎉

Open gdassori opened this issue 4 years ago • 1 comments

The txindex is huge. I estimate that some sort of firstbits implementation would reduce the txindex size down to 20-25%, even less! And this is awesome.

The downside is having a bit more iterations while lurking, maybe, but.. who cares? 20%!

gdassori avatar Jun 15 '21 19:06 gdassori

It is very intensive to index the Firstbits, because an iterator must be run at every write operation. To avoid bottlenecks, the FB compression must be run into a separate task. Transactions must be indexed on a normal DB and moved to the Firstbits index later. It sounds good to run the whole Transactions Index process as separated.

It may take up to a while to sync a full node on a low-end VPS and compress the transactions index.

gdassori avatar Jun 15 '21 21:06 gdassori