replicate-python
replicate-python copied to clipboard
replicate
Python client for Replicate
Is there any way to store large models in some kind of network storage to avoid long cold boot times?
request feature to support directly uploading output to provided s3 path(any cloud storage) similar to below request: replicate.run( "stability-ai/stable-diffusion:27b93a2413e7f36cd83da926f3656280b2931564ff050bf9575f1fdf9bcd7478", input={"prompt": "a 19th century portrait of a wombat gentleman"}, **_s3_key_id="AWS_ACCESS_KEY_ID", s3_access_key="AWS_SECRET_ACCESS_KEY",...
I got this error message executing the code in Ec2 AWS Linux Ubuntu 22.04.2 (not locally): [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007) Replicate v. 0.23.1 Error log:...
To calculate the cost of a prediction 3 values are needed - Prediction time (returned as part of `GET prediction`) - Hardware on which the model was run - Price/sec...
I made a prediction to a Mistral model and received the following error: ```sh Traceback (most recent call last): File "/Users/joaoabrantis/Desktop/sakana/languagemodels/debate.py", line 45, in correct = debate([models[n] for n in...
I would like to be able to spin up and shutdown deployments from the API. From looking over the API and python client, this doesn’t seem possible. Am I missing...
Hi, I'm working on deploying a private language model to production through Replicate. I have requests coming in sporadically so provisioning always-on servers is not feasible for me, but I...
Followup to https://github.com/replicate/replicate-python/pull/207
When I use replicate.com I can see predictions for a specific version: https://replicate.com/predictions?version=7a5d96bdd41ffe8c449f6c6818a9aaa31db3fb4d7d7154feef3fd778318c64a3 Is it possible to have the client/api do the same thing? https://replicate.com/docs/reference/http#predictions.list doesn't seem to have the...
