scrapi
scrapi copied to clipboard
[WIP] Post processing for URLs and Contributors
Add tasks and process for querying the status of URLs, and inforation gathering about contributors in scrapi normalized documents.
Addresses [#SHARE-105] for contributor gathering, and improves URL processing by saving it to a postgres table instead of just throwing it in the normalized doc