Mooncake icon indicating copy to clipboard operation
Mooncake copied to clipboard

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Results 100 Mooncake issues
Sort by recently updated
recently updated
newest added

### Describe your feature request Enable user-defined certificate authentication for Mooncake clients joining deployments. ### Before submitting a new issue... - [ ] Make sure you already searched for relevant...

### Describe your usage question 使用英特尔E810的RDMA网卡, PC1的ip是100.100.100.1, enp5s0f0: flags=4163 mtu 4096 inet 100.100.100.1 netmask 255.255.255.0 broadcast 0.0.0.0 txqueuelen 1000 (Ethernet) RX packets 3748 bytes 289039 (289.0 KB) RX errors 0...

## Description This PR refactored the AllocationStrategy implementation according to the RFC #1131 . Unit tests and documentations are also updated accordingly. ## Type of Change * Types - [...

run-ci

…TC) control to improve ordering flexibility and queue-level QoS ## Description This PR optimizes Mooncake’s performance in the 2P1D scenario by introducing two main improvements: 1. **Relaxed Ordering (RO) support**...

run-ci

## Description This is a sub-PR of coro rpc communicator. https://github.com/kvcache-ai/Mooncake/pull/795 This PR includes the core part of Coro_rpc. Header and implementation of the PR. ## Type of Change *...

run-ci

## Description *(AI Assist)* This PR improves AMD GPU support by migrating to automated CUDA-to-HIP conversion using `hipify-perl`. **Key Changes:** 1. **Automated CUDA-to-HIP conversion with `hipify-perl`** - Introduced `hipify_files()` CMake...

run-ci

## Description * There is a `Query` funcs in `client_service.cpp`, which providing query replica_descriptor ability. But I haven't seen a pybind interface that provides this implementation. And I want to...

run-ci

The FileStorage class will be responsible for managing the entire lifecycle of key-value objects, including: - Storing new objects (Put) - Retrieving existing objects (Get) - Deleting objects - Tracking...

run-ci

…ct to blog ## Description Motivation: - Regarding the [issues#1060](https://github.com/kvcache-ai/Mooncake/issues/1060) mentioned earlier, the content and responsibilities of the doc and docs documents overlap, making the cost of maintaining both sets...

run-ci

- Move documentation files from doc/ to docs/source/ directory - Reorganize English and Chinese documentation files ## Description ## Type of Change * Types - [ ] Bug fix -...

run-ci