Rajveer Bachkaniwala comments

Repositories
Issues
Comments

Results 2 comments of


                                            Rajveer Bachkaniwala

Segmentation Fault in pytorch data loader while using multiple workers

@emeryberger **Issue:** I am running into the same error as pointed above on the same lines. Using `persistent_workers` as `True` does not resolve the issue. Also, the issue is specific...

[Feature][Frontend] Add KVTransferParams for disaggregated prefill feature

@ShangmingCai Is this change going into vLLM v0 or v1? It seems like v0. I am looking forward to using this as soon as possible, but I would like to...