lmdeploy
lmdeploy copied to clipboard
[Feature] Any plan for support Minfernece?
Motivation
Minference source code: https://github.com/microsoft/MInference paper: https://arxiv.org/pdf/2407.02490
Related resources
No response
Additional context
No response
mark
Let's investigate this work @RunningLeon
mark