Nathan Figueroa

Buffer response with binary status validation always throws 500

1

#### Support plan * *is this issue currently blocking your project?* (yes/no): no * *is this issue affecting a production system?* (yes/no): yes #### Context * *node version*: 12 *...

sglang support?

3

The [announcement blog post](https://llava-vl.github.io/blog/2024-04-30-llava-next-video/) indicates inference can be done with sglang, but attempting to load the 7b model with the sglang backend: ``` python -m sglang.launch_server --model-path ~/models/lmms-lab_LLaVA-NeXT-Video-7B-DPO --port 30000...

Documentation asks user to build in root of cloned repo: https://docs.portainer.io/advanced/app-templates/build There is no Dockerfile.