Script ends with requests.exceptions.TooManyRedirects

[zcbenz]

After executing the script for some time, it ends with TooManyRedirects exception.

$ python main.py 
ff566415(v=vs.85).aspx (63989 remaining, 54834 visited)                    
Traceback (most recent call last):
  File "main.py", line 57, in <module>
    main()
  File "main.py", line 48, in main
    crawl()
  File "main.py", line 34, in crawl
    cur_url_html = page_getter.urlretrieve(remote_url, local_url)
  File "/Users/zcbenz/codes/msdn_docset/page_getter.py", line 8, in urlretrieve
    response = self._session.get(remote_url)
  File "/Library/Python/2.7/site-packages/requests/sessions.py", line 480, in get
    return self.request('GET', url, **kwargs)
  File "/Library/Python/2.7/site-packages/requests/sessions.py", line 468, in request
    resp = self.send(prep, **send_kwargs)
  File "/Library/Python/2.7/site-packages/requests/sessions.py", line 597, in send
    history = [resp for resp in gen] if allow_redirects else []
  File "/Library/Python/2.7/site-packages/requests/sessions.py", line 113, in resolve_redirects
    raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects)
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.