Dan Cropley
Dan Cropley
Thanks @barbequesauce, good work. I'll switch repos now.
Thanks Leo. Just to confirm, this should be: ``` search_phrase+=" site:${element} OR" ``` Is that correct?
OK, now using SIGABRT, but finding that I need to background each image download command, then grab its PID, then kill that PID if it turns out we're going to...
Also need to save output from backgrounded downloader regarding exit status and messages.
Ugh... I can't reliably catch and kill each background process and ensure it hasn't already downloaded an image, but not yet marked it as complete. There's a narrow window of...
> What the scenario here? That the user aborts the run? Yes, but aborting also happens during a regular run. That's the one I'm testing. When we have enough images,...
today's progress: getting there. :smile: I've written from scratch a new and quite simple version of the downloading functions used in googliser. For testing, it can run upto 500 instances...
Threw a quick scraper together that seems to work (haven't pushed it up to here yet). But it's only finding a maximum of 104 unique images across 10 pages. Hmm...
OK we're out of action for now. I'll need to decode the endless-page scripting in order to request more than a single page of image results. I'm not in a...
If anyone would like to have a shot at fixing this, you're more than welcome. :grin: The current issue is: I can scrape the new results page, but can't trigger...