Question: Crawling of onion domains found in pastes automatically feeded to ail by e.g. pystemon

[certrik]

Regarding the crawling of onion domains found in pastes ... Is it correct that those domains are only crawled once a month and not when they are automatically feeded to ail by e.g pystemon? If this is correct this information would be a good addition to the readme.md .

[Terrtia]

Hi @certrik ! Indeed, domains found by the onions module are only crawled once a month. (new domain are inserted in a priority queue) We should add a crawler page in the documentation.