public-roadmap icon indicating copy to clipboard operation
public-roadmap copied to clipboard

[New API] Add Bulk Search API

Open kagermanov27 opened this issue 3 years ago • 9 comments

Provide an ability to do 1,000,000+ searches (Flow is called "Bulk Search API")

  1. Submit 1M+ via scheduled=true
  2. 1,000,000+ searches get processed in 1..24 hours
  3. Customer is checking next day (related to https://github.com/serpapi/public-roadmap/issues/65) or similarly to the current suggested usage of async=true searches.

Documentation can be under https://serpapi.com/bulk-search-api.


Past Canny Link · Private PR in progress


We can address separately with a manual custom solution, when a customer wants to make 50,000,000 non-blocking searches daily to be processed ASAP.

kagermanov27 avatar Mar 10 '22 14:03 kagermanov27

Hi, hopefully this batch request feature will make it in soon. For me, as well as the query itself we could pass in other paramaters such as the maximum number of results to receive, which engine / location / tbs etc...and importantly each search to pass in a custom ID so we can easily link the results back up once they're processed, bonus points for a call to a webhook when it's completed / status change on the job.

leemul avatar Aug 03 '22 09:08 leemul

Looking forward to this being implemented.

Toffee1878 avatar Apr 27 '23 00:04 Toffee1878

@Toffee1878 This feature is currently under active development. There is no approximate release date for users yet. At least at the time, I'm writing this message 🙂

dimitryzub avatar Apr 27 '23 04:04 dimitryzub

Another user requested this:

Intercom

schaferyan avatar Sep 20 '23 17:09 schaferyan

Another user requested this:

Intercom

martin-serpapi avatar Oct 31 '23 13:10 martin-serpapi

Another request for this:

Intercom

schaferyan avatar Jan 04 '24 17:01 schaferyan

An Enterprise Customer requested this:

Intercom

schaferyan avatar Feb 27 '24 18:02 schaferyan

Can't wait to use this!

ProV1X avatar Jun 09 '24 03:06 ProV1X

An Enterprise user requested this.

Intercom

hilmanski avatar Sep 26 '24 05:09 hilmanski