InfinityCrawler
InfinityCrawler copied to clipboard
TurnerSoftware
A simple but powerful web crawler library for .NET
Currently Infinity Crawler uses HtmlAgilityPack which has served the project well. AngleSharp is an alternative HTML processing implementation which has a strong focus on performance and extendability. While I don't...
Follows on from discussions in #63 - currently the `HostAlias` setting is relatively limited, requiring an exact match before it crawls a link with that domain. To make crawling a...
For example, I was thinking of using this library to crawl a single site for pages. This library looks great by the way - much higher quality than any of...
[](https://renovatebot.com) Welcome to [Renovate](https://togithub.com/renovatebot/renovate)! This is an onboarding PR to help you understand and configure settings before regular Pull Requests begin. 🚦 To activate Renovate, merge this Pull Request....
![renovate[bot] avatar](https://avatars.githubusercontent.com/in/2740?v=4 "renovate[bot] avatar"){kind=avatar}
Bumps [BenchmarkDotNet](https://github.com/dotnet/BenchmarkDotNet) from 0.13.8 to 0.13.11. Release notes Sourced from BenchmarkDotNet's releases. 0.13.11 Full changelog: https://benchmarkdotnet.org/changelog/v0.13.11.html In the v0.13.11 scope, 4 issues were resolved and 8 pull requests were merged....
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [Microsoft.SourceLink.GitHub](https://github.com/dotnet/sourcelink) from 1.1.1 to 8.0.0. Commits See full diff in compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter...
Bumps [Microsoft.Extensions.Logging.Debug](https://github.com/dotnet/runtime) from 3.1.22 to 8.0.0. Release notes Sourced from Microsoft.Extensions.Logging.Debug's releases. .NET 8.0.0 Release .NET 8.0 RC 2 Release .NET 8.0 RC 1 Release .NET 8.0 Preview 7 Release...
Bumps [Microsoft.Extensions.Logging.Console](https://github.com/dotnet/runtime) from 3.1.22 to 8.0.0. Release notes Sourced from Microsoft.Extensions.Logging.Console's releases. .NET 8.0.0 Release .NET 8.0 RC 2 Release .NET 8.0 RC 1 Release .NET 8.0 Preview 7 Release...
Bumps [Microsoft.Extensions.Logging.TraceSource](https://github.com/dotnet/runtime) from 3.1.22 to 8.0.0. Release notes Sourced from Microsoft.Extensions.Logging.TraceSource's releases. .NET 8.0.0 Release .NET 8.0 RC 2 Release .NET 8.0 RC 1 Release .NET 8.0 Preview 7 Release...
Bumps [Microsoft.NET.Test.Sdk](https://github.com/microsoft/vstest) from 17.6.3 to 17.8.0. Release notes Sourced from Microsoft.NET.Test.Sdk's releases. v17.8.0 What's Changed Full Changelog: https://github.com/microsoft/vstest/compare/v17.7.2...v17.8.0 v17.8.0-release-23468-02 What's Changed Upgrade Newtonsoft.Json from 13.0.1 to 13.0.3 by @mthalman in...
Metadata
Owner
Metadata
A simple but powerful web crawler library for .NET