yemin1996

Results 2 comments of yemin1996

How to load my local model

I also find that deploy_rank seems does not work

Deepspeed Inference not working on llama when input has padding and using kernel injection

I have the same problem on vicuna7b model