Sudarshan Kamath Barkur
Sudarshan Kamath Barkur
I guess the path to the image is not correct and it is not able to open the file.
Hi, I had the same problem. This was because of the following reason: The zeroth class is the background and I was having a dataset for detecting only a single...
Hi, as you are already aware, if you use the worker for the generation, you get the streaming output. If you need all the outputs at once, you can look...
+1 EDIT: I just checked the code of vLLM and it allows you to set the number of speculative tokens to 1, which then downloads this model: "luccafong/deepseek_mtp_draft_random" from Huggingface,...