LinkCrawler

LinkCrawler copied to clipboard

EBWeist

Output to SqlLite db file

9

hmol

dotnet core anyone?

3

Any inputs on wether we should port this over to dotnet core?

hmol

It looks like the example links on the readme are broken. Things like "Example run with console output" go to a page that says "Cannot proxy the given URL". Thank...

schneiderl

Not sure how to change a pr so I closed the old one and created this one instead.

floodpants

PatMyron

Follow redirects feature

2

If the server responds with redirect (301 or 302), the crawler should follow these redirects (like curl is able for example), otherwise it's missing a bunch of crawlable content

firecodergithub

Added a couple of unit tests for TrimEnd string extension. Moved a test file that was in a folder that didn't correspond to it's implementation folder Created unit tests for...

davetolan

Hello dear HMol, i got to your project using up-for-grabs which saw a few issues one could help with. I wrote a few unit tests for you to up your...

stho32

When outputting info about broken link, one should also consider outputting link text

4

hmol