PySitemap

PySitemap copied to clipboard

Hello, somewhere there are restrictions on the length of urls, since urls longer than 300 for some reason are not included in the sitemap. It should be added that they...

mrkaban

urllib.error.HTTPError: HTTP Error 400: Bad Request

2

https://github.com/Cartman720/PySitemap/blob/61c728f6b7824dcdace7ac61ca05cf267c52e23e/crawler.py#L26 Putting this under a try block should stop the script from crashing

PandaWhoCodes

Not found

1

I get this: ``` Parsing http://canterano.somenxavier.xyz/trobar-mesures-figures-vnps/figures-1.ggb Traceback (most recent call last): File "main.py", line 21, in links = crawler.start() File "/home/xan/Baixades/sitemap/PySitemap-master/crawler.py", line 17, in start self.crawl(self.url) File "/home/xan/Baixades/sitemap/PySitemap-master/crawler.py", line 49,...

ghost

HTTP Error 403: Forbidden

1

Traceback (most recent call last): File "main.py", line 21, in links = crawler.start() File "\crawler.py", line 17, in start self.crawl(self.url) File "\crawler.py", line 26, in crawl response = urllib.request.urlopen(url) File...

exportio

``` Ampersand | & | &amp; Single Quote | ' | &apos; Double Quote | " | &quot; Greater Than | > | &gt; Less Than | < | &lt;...

x011

In crawler.py, there's this code: ```python try: response = urllib.request.urlopen(url) except: print('404 error') return ``` However, 404 is not the only possible exception that can occur with urllib.request.urlopen(). Solution: ```python...

prrifth