subcrawl
subcrawl copied to clipboard
URL parsing not validating certain URLs
I've noticed issues where URLs such as hxxp://34.105.85[.]231/DODO/ doesn't get validated and added to the crawl queue.