Junlong Li

icon indicating a website link https://lockon-n.github.io/

icon company The Hong Kong University of Science and Technology icon location Hong Kong, China

Results 1 issues of Junlong Li

LLaVA model parallelism/fork bug

Thanks for this wonderful work! I was trying to use parallel inference/fork in sglang for the llava 1.5 model. Here is my env: ``` torch 2.1.2+cu118 sglang: built from main...