Medusa icon indicating copy to clipboard operation
Medusa copied to clipboard

updated medusa models in huggingface?

Open hustxiayang opened this issue 1 year ago • 0 comments

Hi, based on https://github.com/FasterDecoding/Medusa/blob/main/notebooks/medusa_introduction.ipynb, "FasterDecoding/medusa-vicuna-7b-v1.3" should have 4 medusa_num_heads. However, in huggingface, it only has 2, https://huggingface.co/FasterDecoding/medusa-vicuna-7b-v1.3/blob/main/config.json. Do you have any plan to share the trained medusa-heads in huggingface?

hustxiayang avatar Jul 25 '24 17:07 hustxiayang