gocomics robots.txt blocking

[hendersj]

Mostly just calling this out - started yesterday, so those comics no longer download. Probably need to find alternate sources for them.

[SKDzd]

I suggest a --respect-robots option, like --adult

This will have to remove dosagelib/util.py check_robotstxt() IOError

[TobiX]

They seem to have changed the robots.txt to not block us, closing.