Lee Semel comments

Results 11 comments of


                                            Lee Semel

Encoding select_related

I tried looping over them but it still doesn't pull in my model, which has a OneToOne relationship with the main one. Does it work with OneToOne models?

Fails with 'too many open files'

When I move the calls to enable and disable to setupClass and teardownClass, disable doesn't seem to fully take effect and blocks http calls on subsequent unrelated tests.

Where is the index persisted?

Looks like it writes some files out to ./target/base/index, but I haven't figured out how to get it to reload them when restarting the process. Also, I saw a "dir"...

Where is the index persisted?

That's pretty important because without that we'd have to be 100% perfect at keeping it running without it stopping or crashing, or face long periods of downtime as it reloads...

Fix title extraction if title is same as site_name

Any chance of merging this? Getting bitten by index errors when parsing the title

Getting a No Such File or Directory error

When I pass 'local_storage_path' as None to Goose, I get another error, `AttributeError: 'NoneType' object has no attribute 'endswith'`in the release_resources method in crawler.py

Error in title extractor

I'm also encountering this same error.

Getting all your thumbnails at once from a list of objects

Any progress on this? Is there any way to use select_related() or prefetch_related() on a queryset to reduce the number of database lookups of thumbnails?

Getting all your thumbnails at once from a list of objects

Any news on this?

Requests 2.0 support

Getting the same thing, it's trying to parse domains as ips