replicate-javascript icon indicating copy to clipboard operation
replicate-javascript copied to clipboard

`wait` param for `replicate.run` doesn't work

Open zhuk-aa opened this issue 1 year ago • 0 comments

This morning meta/meta-llama-3-70b-instruct was failing to run. I tried adding wait param to make it fail if no response comes in 10s but it hasn't changed anything. const output = await replicate.run("meta/meta-llama-3-70b-instruct", { input, wait: 10 });

Now the model is up again, but adding wait doesn't change anything.

Proposal:

  • make sure there is a way to define after what time the call would timeout
  • in case wait isn't meant for this - update docs for wait. At the moment it's not clear to me what ti does

Thank you ☀️

zhuk-aa avatar Oct 07 '24 07:10 zhuk-aa