runpod-python icon indicating copy to clipboard operation
runpod-python copied to clipboard

GPU availability check before deployment

Open burnpiro opened this issue 2 years ago • 2 comments

Is your feature request related to a problem? Please describe. When I want to deploy the pod in the specific location I cannot get information about availability in that location. Current gpu_query allows only to specify gpu_id and gpu_count to get the list of GPUs.

Describe the solution you'd like I would like to be able to send a get request to check if there is a GPU with given parameters (the same as I latter provide to create_pod()).

Describe alternatives you've considered Maybe an external API to request data from (beside python lib)?

Additional context None

burnpiro avatar Jan 15 '24 22:01 burnpiro

I can add a general availability check; however, this would not help when the GPU becomes unavailable between checking and creating the pod. Is that what you are looking for?

justinmerrell avatar Jan 21 '24 19:01 justinmerrell

I've just raised #307 to retrieve the machine information necessary from the runpod GraphQL API to enable this.

dvejmz avatar Mar 29 '24 15:03 dvejmz