Shanshan Shen
Shanshan Shen
@comfyanonymous I have merged the latest codes to this commit, and have tested it on NPU (Atlas 300T A2), the result showed it worked well. Would you mind merging this?...
@johnnynunez Could you please update the xgrammar version in requirement to [v0.1.14](https://github.com/mlc-ai/xgrammar/releases/tag/v0.1.14) ? Then I will colse my PR. Find more details at [here](https://github.com/vllm-project/vllm/pull/14030).
I have tested the same example on my device, and have got a `None` content. It’s unclear whether this problem stems from my npu device or the implementation itself. The...
> [@shen-shanshan](https://github.com/shen-shanshan), you could check out this PR and test the provided example to verify whether it works on the NPU. [#14114](https://github.com/vllm-project/vllm/pull/14114) I have tested this PR on my device...
@youkaichao I have updated a new version for this refactor. By directly adding `__getattr__()` method to `Platform`, all kinds of hardware can get their `Stream`, `Event` or other attribute without...