shuyabin
shuyabin
支持
因为是想做增量采集. 两个站点的采集时间不定..
我主要想的是. 如何通过网页的异步.执行spider. 大腿有没有什么思路求指导一下.
hh大佬能否提供个思路,我看到大佬的代码是for然后运行的。
在你的run函数里加个监听端口的代码,或者 死循环的代码
``` async def run_logic_task(self, func_name, *args, **kwargs): """ :param func_name: :param args: :param kwargs: :return: """ try: “”“ There are many functions that are called in this way ”“” await...
My requirement is for a dynamic proxy. I need a logic that is instantiated only once during its lifecycle. If using async with, I would need to pass the session...