Andrew Baxter

Cannot override log related spider settings

8

AFAICT it's not possible to override LOG_LEVEL, LOG_FILE, LOG_DIR, etc for spiders because the dict from get_scrapyrt_settings is applied with priority 'cmdline'. I assume this is due to conflicting goals:...

File upload hangs (2)

5

I'm not sure if this is the same as the other "file upload hangs" issue. On 1.13.5, randomly large uploads just stop uploading. This is with concurrent writes off, a...

I had difficulty figuring out how to use jsonschema

2

Following https://spidermon.readthedocs.io/en/latest/item-validation.html#with-json-schema I set up ITEM_PIPELINES then jumped down to the jsonschema section, but there are no settings listed there for how to use jsonschema. After that I scanned the...

Option to stop spider on errors

15

I think it would be nice to have validation errors treated like other spider errors - increment the error counter, optionally stop the spider with an error condition if over...

Action to restart spider in Scrapy Cloud

4

Discussed in chat a bit - the idea is that if a job meets some conditions (monitor detects certain website responses, the job stalls, etc) this action could restart the...

Make *Bytes() function public

5

Our use case is we need to send data files and scripts to run on remote servers. In this case the specific file used depends on the step and is...

Documentation Is: - [ ] Missing - [ ] Needed - [x] Confusing - [ ] Not Sure? ### Please Explain in Detail... The descriptions for the two are not...

EmbeddedFilesEndpoint strip prefix

1

## Description of the feature Allow specifying a prefix to be trimmed from url paths before resolving embedded files. For instance, right now a request to ``` /assets/abc.jpg ``` will...

Cannot find definitions with baseUrl

3

# Bug Report ### 🔎 Search Terms `typescript "cannot find a declaration file" baseurl` `typescript "cannot find a declaration file" strace` `"Could not find a declaration file for module 'marked'"`...

I think rust generally gives up with formatting macros, but it seems like some function-style macros will be automatically formatted. `log!("message", "a"="b", "c"="something else")` will actually be wrapped and spaced...