Cheetah

Support FSDP worker and vLLM Ascend

6

This pr is committed for supporting Ascend NPU backend. Co-authored-by: Chendong98 [[email protected]](mailto:[email protected]) Co-authored-by: zheliuyu Co-authored-by: celestialli [[email protected]](mailto:[email protected]) In this pr, we add the capability to determine the type of NPU...

Specify ASCEND NPU for inference.

1

## Why are these changes needed? When deploying inference services with ASCEND NPU, it is not possible to specify the card to be used. @infwinston @CodingWithTim ## Related issue number...