求scrapy中间件

[gsoec]

[ResolveWang]

这个需求您可以直接使用py_cli.py进行对接啊

[yuxiaorui]

@gsoec 用py_cli.py里面的ProxyFetcher，不到10行代码就可以实现。

from haipporoxy.client import ProxyFetcher

class CustomProxyMiddleware(HttpProxyMiddleware):
    fetcher = ProxyFetcher('zhihu', strategy='greedy', length=5)

    def process_request(self, request, spider):
        proxy = self.fetcher.get_proxy()
        print "**************ProxyMiddleware no pass************" + proxy
        request.meta['proxy'] = self.fetcher.get_proxy()