replicate-examples

replicate-examples copied to clipboard

vLLM examples aren't working

1

I've gotten a [report](https://github.com/replicate/cog/issues/1567) about Cog not working with some of the language models in this repo. In particular, [llama-2-70b-chat-awq](https://github.com/nateraw/replicate-examples/tree/main/llama-2-70b-chat-awq) and [mixtral-instruct](https://github.com/nateraw/replicate-examples/tree/main/mixtral-instruct). Could you please consider removing these examples and/or...

mattt

In video background remover replicate

4

In video background remover replicate . I have successful deployed on replicate through your code . But at the runtime i am getting this error Prediction failed. torch.cat(): expected a...

tahercoolguy