ProxyPool icon indicating copy to clipboard operation
ProxyPool copied to clipboard

Windows 环境下常规方式运行会重复多次启动进程

Open LEIRONGHUA opened this issue 2 years ago • 0 comments

Describe the bug Windows 命令提示下,运行python3 run.py 命令会重复启动。

Environments (please complete the following information):

  • OS: Windows 11 22H2
  • Python:Python 3.10.4

Additional context 日志记录如下,在11:13:07就已经启动了三个进程,为何在11:13:12左右又开始启动? ` 2023-03-09 11:13:07.871 | INFO | main:run:100 - starting proxypool... 2023-03-09 11:13:07.872 | INFO | main:run:104 - starting tester, pid None... 2023-03-09 11:13:07.881 | INFO | main:run:110 - starting getter, pid None... 2023-03-09 11:13:07.887 | INFO | main:run:116 - starting server, pid None... 2023-03-09 11:13:10.113 | DEBUG | mp_main:run_tester:33 - tester loop 0 start... 2023-03-09 11:13:10.114 | INFO | proxypool.processors.tester:run:74 - stating tester... 2023-03-09 11:13:10.143 | DEBUG | proxypool.processors.tester:run:76 - 13628 proxies to test 2023-03-09 11:13:10.143 | DEBUG | proxypool.processors.tester:run:79 - testing proxies use cursor 0, count 200 2023-03-09 11:13:10.164 | DEBUG | proxypool.processors.tester:test:42 - testing 185.66.59.4:42647 2023-03-09 11:13:10.186 | DEBUG | proxypool.processors.tester:test:42 - testing 220.179.210.239:8089 2023-03-09 11:13:10.187 | DEBUG | proxypool.processors.tester:test:42 - testing 203.223.171.185:4145 2023-03-09 11:13:10.335 | DEBUG | mp_main:run_getter:48 - getter loop 0 start... 2023-03-09 11:13:12.610 | INFO | main:run:100 - starting proxypool... 2023-03-09 11:13:12.611 | INFO | main:run:104 - starting tester, pid None... 2023-03-09 11:13:12.612 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 183.164.245.134:8089 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.617 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 35.174.204.39:9999 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.619 | INFO | main:run:110 - starting getter, pid None... 2023-03-09 11:13:12.621 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 91.249.134.148:80 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.626 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 82.98.147.36:80 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.628 | INFO | proxypool.storages.redis:decrease:84 - 203.28.8.252:80 score decrease 1, current 2.0 2023-03-09 11:13:12.628 | DEBUG | proxypool.processors.tester:test:65 - proxy 203.28.8.252:80 is invalid, decrease score 2023-03-09 11:13:12.631 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 27.157.228.206:8089 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.632 | INFO | main:run:116 - starting server, pid None...

LEIRONGHUA avatar Mar 09 '23 04:03 LEIRONGHUA