Tianle Cai
Results
4
issues of
Tianle Cai
Roadmap
15
# Roadmap ## Functionality - [x] #36 - [x] #39 - [ ] Distill from any model without access to the original training data - [ ] Batched inference -...
documentation
https://github.com/mlc-ai/mlc-llm https://github.com/mlc-ai/llm-perf-bench
enhancement
We are currently running out of bandwidth. Contributors to help integrate Medusa into llama.cpp would be greatly appreciated :)
enhancement