Crawl entire site from sitemap when available (faster than recursive )

[antoniancu]

I suspect performance when checking an entire site would be better with the ability to run the link checker on a set of pages provided by the sitemap when available, vs the recursive crawling process.

An anticipated complexity is really large sites with paginated sitemaps: sitemap.xml?page=1, sitemap.xml?page=2 etc..

[antoniancu]

I solved this by passing an array of pages from sitemapper. Still, it would be neat to have this logic built in.

[JustinBeckwith]

Interesting! I have to go do some learnin' about sitemaps again.