lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard
Published 2 months ago • verified publisher icon InternLM

[Feature] Any plan for support Minfernece?

Open TianzhongSong opened this issue 1 year ago • 3 comments

Motivation

Minference source code: https://github.com/microsoft/MInference paper: https://arxiv.org/pdf/2407.02490

Related resources

No response

Additional context

No response

TianzhongSong avatar Jul 10 '24 06:07 TianzhongSong

mark

maxin9966 avatar Jul 15 '24 18:07 maxin9966

Let's investigate this work @RunningLeon

lvhan028 avatar Jul 16 '24 02:07 lvhan028

mark

luoyangen avatar Jul 26 '24 03:07 luoyangen