hongming yang

icon company ZJGSU icon location A postgraduate student in the field of artificial intelligence security from ZJGSU in China, with an interest in artificial intelligence applications.

Results 1 issues of hongming yang

[Bug] Qwen3-235B FP8 stops responding after a certain number of requests

3 comment

### Model Series Qwen3 ### What are the models used? Qwen3-235B-A22B-FP8 ### What is the scenario where the problem happened? vllm 0.8.5 and sglang ### Is this a known issue?...