Add Crawler Rate Limit

[blakebyrnes]

It is beneficial to sometimes have rate limits that a Crawler should run with so it doesn't overwhelm targets and/or complies with robots limits. (from discord user jeremygiberson)