Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard
Published 4 months ago • verified publisher icon linkedin

Empty Medusa head tensors

Open vkc1vk opened this issue 1 year ago • 0 comments

🐛 Describe the bug

Tensors saved in medusa_only_heads mode are empty. Ref: https://github.com/linkedin/Liger-Kernel/blob/main/examples/medusa/train.py#L392

Reproduce

No response

Versions

N/A

vkc1vk avatar Oct 14 '24 19:10 vkc1vk