cdsapi icon indicating copy to clipboard operation
cdsapi copied to clipboard

Sending multiple requests

Open e5k opened this issue 5 years ago • 3 comments

Hello all, This is a question rather than issue, but is there a way to send requests into the queue (i.e. as from the website) from the python api? Thank you!

e5k avatar Jun 03 '20 09:06 e5k

Yes I have the same question.

chloeprodhomme avatar Feb 15 '22 09:02 chloeprodhomme

@chloeprodhomme That was useful for me: https://github.com/ecmwf/cdsapi/issues/2

e5k avatar Feb 17 '22 12:02 e5k

@chloeprodhomme FYI: https://github.com/e5k/CDSAPItools

e5k avatar Feb 18 '22 08:02 e5k

Hi,

The cdsapi does not offer any means to submit more than one job at a time. If you want to parallelise your submissions you can do this via your own means, as @e5k suggested. However....

Your priority in the queue is calculated based on how many jobs you have currently submitted, therefore to ensure the best results you should submit one by one, or in small numbers. This is to ensure fair usage of our system by all users.

Also, submitting jobs to our queue in too large numbers, too quickly is often identified as suspicious activity and steps will be taken to limit any such users activity.

Many thanks, Eddy

EddyCMWF avatar Feb 28 '23 09:02 EddyCMWF