Switching to AngleSharp

[Turnerj]

Currently Infinity Crawler uses HtmlAgilityPack which has served the project well. AngleSharp is an alternative HTML processing implementation which has a strong focus on performance and extendability.

While I don't have any benchmarks to prove this yet here, I have seen AngleSharp in other projects perform better than HtmlAgilityPack. This isn't the main reason to switch though.

The bigger reason is that with AngleSharp, it becomes easier to support basic JavaScript crawling which can be useful.

There is no current timeline on the change - this issue is to track that there is an intended change at all.