yejj

icon company huawei icon location china icon location focused on vllm-ascend/Ascend NPU @vllm-project

Results 2 issues of yejj

[store] add pybind for get_replica_desc

3 comment

## Description * There is a `Query` funcs in `client_service.cpp`, which providing query replica_descriptor ability. But I haven't seen a pybind interface that provides this implementation. And I want to...

run-ci

[RFC] [Store] support Mooncake file eviction in DFS/3FS

2 comment

### Motivation As mentioned in the previous issue #578 #924, Mooncake has already support KVCache offloading to SSD in 3FS. However, there is currently no mechanism for file cleanup, we'd...

enhancement
high priority