replicate-javascript
replicate-javascript copied to clipboard
`wait` param for `replicate.run` doesn't work
This morning meta/meta-llama-3-70b-instruct was failing to run. I tried adding wait param to make it fail if no response comes in 10s but it hasn't changed anything.
const output = await replicate.run("meta/meta-llama-3-70b-instruct", { input, wait: 10 });
Now the model is up again, but adding wait doesn't change anything.
Proposal:
- make sure there is a way to define after what time the call would timeout
- in case
waitisn't meant for this - update docs for wait. At the moment it's not clear to me what ti does
Thank you ☀️