PainlessInferenceAcceleration icon indicating copy to clipboard operation
PainlessInferenceAcceleration copied to clipboard

Consider Support CodeLlama?

Open RainYQ opened this issue 2 years ago • 2 comments

Consider to provide official CodeLlama inference speed up support.

RainYQ avatar Jan 30 '24 03:01 RainYQ

Will release after test.

chenliangjyj avatar Jan 30 '24 10:01 chenliangjyj

The example of CodeLlama can be found here.

chenliangjyj avatar Feb 01 '24 08:02 chenliangjyj