[Usage]: How to config Mooncake client to store the KV cache to remote Mooncake L3, instead of local Mooncake L3.

[Dictria]

Describe your usage question

Hi, Mooncake team! We want to disaggregate sglang inference node and mooncake kv store node.

We set the fs_dir in master service. We want the KV cache only stores in the mooncake node. And the mooncake client on sglang node only issue gut/put. However, the client on the sglang node store its kv cache in its local fs_dir.

Following the documentation guidance: We set global_segment_size to 0 for client in sglang node. It seems only not contributes to Mooncake L2, but L3 storage still functions normally.

Is it possible to disable fs_dir for the mooncake client on the sglang Node? Thank you.

Before submitting a new issue...

• [x] Make sure you already searched for relevant issues and read the documentation

[yejj710]

you can see more details on (Mooncake/mooncake-store/src/client.cpp Put function). I think the current version does not support