souyang11
souyang11
请问有遇到训练后画质变模糊么？
Hello, I am currently using sglang + yuhuili/EAGLE-Qwen2-7B-Instruct for inference, and I noticed that the throughput has slowed down. Do you know the reason for this? thank you.
> Have you solved this problem yet? I encountered the same issue while using sglang + eagle. Here is my deployment script: > > CUDA_VISIBLE_DEVICES=2,5 python3 -m sglang.launch_server \ >...
> You can refer to eagle/ge_data/ge_data_all_qwen2.py. Hello, it seems that the file cannot be found at the moment. Could you please upload it? Thank you.