David Read comments

Repositories
Issues
Comments

Results 144 comments of


                                            David Read

Fail for really large responses

Yes, we have plenty of files of hundreds of Mb so recommend it. e.g. http://data.police.uk/data/archive/ is about 12GB / year. You could check also the Content-Length header when you first...

Add test for URLs with non-ASCII characters in them

BTW we have this code in our archiver which may or may not be any good: ''' 409 # Find out if it has unicode characters, and if it does,...

Handle different link check failures differently

And of course requests.exceptions.TooManyRedirects - usually loops, but the classic is when it redirects to itself.

Tighten Default Pod Network Security: Prevent all egress by default

Awesome!! I'll circulate this