mxdev88
mxdev88
I suppose an API endpoint `deljob.json` could be added similar to [delversion](https://github.com/scrapy/scrapyd/blob/master/docs/api.rst#delversionjson) for this purpose. Personally, I think it could be useful. I would let the project maintainers comment on...
It would work as well by reading directly environment variables. How would we handle/define more complex cases with multiple targets? It would require a naming convention. **EDIT** The reason why...
hey @jpmckinney, I've PR'ed this idea in #106. Let me know what you think. thanks!
@jpmckinney do you have any more comments or suggestions on this?
> Currently there is no built-in way to do this. > > A first option would be to use `request.meta['splash']['args']['proxy']` instead of `request.meta['proxy']` here: > > https://github.com/TeamHG-Memex/scrapy-rotating-proxies/blob/35bb23c28d95bdea7d0ae6e964954a48ee927aa2/rotating_proxies/middlewares.py#L110 > > ,...
> And is news-please any more reliable? news-please depends on [newspaper3k](https://github.com/fhamborg/news-please/blob/cd95ac5dc92bae32008e75536a2512e2992b9323/requirements.txt#L10) so it cannot be considered more reliable. news-please however is an active project. We are better off getting in...
It does not seem to be active at all. 400 open issues and over 90 open PRs. The latest commits from 2020 were mostly updates to README. @codelucas could you...
I wonder how this feature would be expected to behave if one calls it for pending or running jobs. Shall we consider that one calling `deljob` would behave as a...
> What state does a canceled job end up in? Looking at the code it gets removed from the queue if pending or killed if running so no state; the...
Makes sense!