wappalyzer icon indicating copy to clipboard operation
wappalyzer copied to clipboard
verified publisher icon HTTPArchive

Wappalyzer data upload

Open max-ostapenko opened this issue 1 year ago • 0 comments

  • [x] metadata upload script to wappalyzer.apps table
  • [x] icons upload to gs://wappalizer-icons/

@rviscomi @tunetheweb upon some ideas of reusing technology data further I thought we could sync the data from repository to the corresponding storages:

  • BigQuery for further analysis (e.g. rules list performance #33 )
  • cloud storage to be used in CWV Tech Report (HTTPArchive/httparchive.org/issues/733)

Can be run as a monthly upload action, to be in time for a new crawl data appended.

max-ostapenko avatar May 19 '24 11:05 max-ostapenko