rakib-hasan

Results 5 comments of rakib-hasan

Medusa convert cpt doesn't work with safetensors version

Thanks for reporting this. @nivibilla You are correct. The script needs to be updated to be able to load safe tensors as well.

How to use Medusa to support non llama models?

Hi @skyCreateXian , thank you for bringing this up. Agreed. We should have a documentation on steps required for making Medusa to work with other models. I think you are...

How to use Medusa to support non llama models?

@skyCreateXian Apologies for the late response. That sounds correct. Changing the position encoding at inference time won't work as the Bloom model seems to be trained with ALiBi. The problem...

Removing the outdated argument

/bot run

Removing the outdated argument

/bot run