Ruiguang Pei
Ruiguang Pei
感觉这个只适用于稳定数据的监控，比如运行稳定的服务器、机器指标等。没法做复杂一些的策略规则
> I modify the prefill func and decode func by pass lora weight in layer forward, and then add new items in mlc llm func table, so some hard code...
Hi，can I help for Multi-layer radix cache (GPU/CPU/Disk)？ Really insterested in that.
> > @lumiere-ml @tanzelin430 Are you in the slack channel? We can follow up on that. > > @lumiere-ml @tanzelin430 Welcome to join our slack channel https://join.slack.com/t/sgl-fru7574/shared_invite/zt-2ngly9muu-t37XiH87qvD~6rVBTkTEHw Thanks for your...
> 有开源计划，我们仍在开发与测试中，本项目会长期维护和持续更新，欢迎届时对sdk提建议和使用反馈 有社区吗，想参与开源开发