Your name may appear around GitHub where you contribute or are mentioned. You can remove it at any time.

Results 33 comments of Your name may appear around GitHub where you contribute or are mentioned. You can remove it at any time.

I tried also using ```--reject``` and ```--reject-regex``` in various combinations to block the downloading of robots.txt and/or the sitemap.txt it references, however, they appear to be handled as a special...

I'm getting a similar but slightly different error ``` $ python3 -m warcat extract 195.242.99.71-8181-2016-03-23-3324e7c6-00000.warc.gz --output-dir output2 --progress --keep-going 47900 | = | Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py",...

Correction, all of the above tests were actually using GnuTLS. Using OpenSSL, I get some of the same errors but there are also differences & new errors: ``` $ time...

I do have access to the web server & I've verified in multiple ways that everything is UTF8. I routinely check via ```iconv -f utf-8 -t utf-8```, ```LC_ALL=C.UTF-8 egrep -laxv...

Tried doing this: ```wget2-master -d -o log.txt --max-threads=1 --no-http2 -m -np https://skyqueen.cc/archive/71master/cracky/kareha.pl/``` However, when debug is turned on, it downloads the first page and then takes forever to write the...

I'm downloading on Ubuntu WSL so that could be complicating things; I'll try it from pure Ubuntu later because WSL sometimes makes weird stuff happen is it even supposed to...

if I run with -v instead of -d it runs & logs at normal speed... if it's a file I/O issue I'm not sure why it would only happen with...

Just from the verbose output, I think I might see what's going on with the "Failed to transcode" errors I think it's seeing external links containing non-ASCII characters and then...

I started a ```-d ``` 98 minutes ago and it's only logged 70676 lines (721 lines per minute, still processing the first file) and started an otherwise identical ```-v``` 73...

Setting aside the debug thing for now and going back to the error messages specifically... I now have a much better understanding of why the error messages are happening and...