yhq

Results 4 issues of yhq

[WIP] Feature/paddleocr inference

[WIP] Support_mask2former_semantic

H2O is slower than full

2 comment

I run `bash scripts/streaming/eval.sh full` and `bash scripts/streaming/eval.sh h2o` on one A100 80G GPU, while full cost 489s, h2o cost 7200s.

Memory leak while using tensor_parallel_size>1

12 comment

![image](https://github.com/vllm-project/vllm/assets/26181650/70c44266-fbb4-4945-a567-78e9eb4c9b06)

bug
unstale