openml-python icon indicating copy to clipboard operation
openml-python copied to clipboard

Bug: openml.runs.list_runs causes server error for large offsets

Open TheRazorace opened this issue 1 month ago • 1 comments

Hi!

I've been trying to update a database I have consisting of OpenML runs with the latest runs in the platforms. For that reason, I have been trying to use openml.runs.list_runs with large offsets (e.g., 10,000,000). However, for these large offsets, the function produces the following exception:

`Unexpected server error when calling https://www.openml.org/api/v1/xml/run/list/limit/10000/offset/10037963. Please contact the developers! Status code: 504

504 Gateway Time-out

504 Gateway Time-out


nginx
`

Do you advise on checking all ids after my offset one by one to fetch runs individually instead of using list_runs?

Thank you!

TheRazorace avatar Dec 11 '25 17:12 TheRazorace

Update: I sloved my problem by using an id list instead of size and offset. Still think it's meaningful to report the original error.

TheRazorace avatar Dec 11 '25 17:12 TheRazorace