Improve link checker

[asafashirov]

• Add support for processing all sitemap files (not just main sitemap)
• Implement section filtering capability
• Enhance error handling and progress tracking
• Improve reporting with a complete list of broken links

[pulumi-bot]

Your site preview for commit 0c8ed6fc is ready! :tada:

http://www-testing-pulumi-docs-origin-pr-14871-0c8ed6fc.s3-website.us-west-2.amazonaws.com.

[shughes26]

We can look into this deeper post-launch, but I would be concerned making changes to our CI process pre-launch

[asafashirov]

Thanks @shughes26. Can/should we capture https://github.com/pulumi/docs/pull/15080 under the same workflow? I.e. does it make sense to make sure all external links open in new windows/tabs when we want them to as part of the link checker workflow?

[dirien]

@asafashirov: is this still needed?

[asafashirov]

Yes! The main thing is making sure all sitemaps are processed/handled accordingly.