etherface icon indicating copy to clipboard operation
etherface copied to clipboard

Offline lookups

Open zerjioang opened this issue 2 years ago • 4 comments

I would like to have a way to run a massive lookup of unverified contracts against this database. However, I think that making it against the online version might impact both application's performance, your server, and my script. For this reason, I would like to propose creating a wikipedia style dump (https://dumps.wikimedia.org/backup-index.html) in which 4bytes information database can be downloaded for offline usage.

zerjioang avatar Apr 12 '23 13:04 zerjioang

I might release a signature dump in the coming days, in the meantime feel free to use the API. I'm sure it can handle your load, though you might want to cache known signatures; see for example https://github.com/uibk-ethpector/ethpector/blob/467428db2254c5baf027374316f49c273bc94a85/src/ethpector/data/signatures.py#L55-L63

volsa avatar Apr 16 '23 21:04 volsa

Hey, would also be interested in a dump. We need to check signatures for all transactions block by block (live every 12 seconds). Is this load okay for now? Of course we would cache / store signatures across blocks. Just for building up the database on our own, it would be great to kickstart with a dump. csv hex, signature would totally suffice.

cgebe avatar May 16 '23 14:05 cgebe

I uploaded a dump on GitHub, had to split them into two parts though because of GitHub's maximum file size restriction. Head over to https://github.com/volsa/etherface/tree/master/signature-dump to download them. Also keep the following two issues in mind

  • https://github.com/volsa/etherface/issues/16
  • https://github.com/volsa/etherface/issues/18

volsa avatar May 22 '23 10:05 volsa

Thank you very much. That will makes things a lot quicker!

cgebe avatar May 22 '23 14:05 cgebe