bethalianovike

[Question] Speculative Decoding Mode

8

## ❓ General Questions How do I get the eagle and medusa mode of the LLM model? I try to do the "convert_weight", "gen_config", and "compile" steps of MLC-LLM with...

## ❓ General Questions What is the meaning behind `draft_count`, `accept_count`, and `spec_draft_length`? Thank you in advance!

Hi, I try to convert tvm ndarray to numpy by dlpack's to_numpy function. If the tvm ndarray's device is CPU, the returned numpy is correct, but if the device is...