DeepSpeed [NPU] Add NPU to support hybrid engine

Add NPU to support the hybrid engine, we tested it with the example on DeepSpeedExample and the results, average reward scores, were aligned with the GPU.

For works about NPU, see https://github.com/microsoft/DeepSpeed/issues/4567

Dec 18 '23 06:12 CurryRice233

@mrwyattii Hi, could you please help to retrigger the workflow and review this PR ？

Dec 22 '23 07:12 CurryRice233

@tjruwase @mrwyattii hi, would you please help to review this PR and add to merge queue? CI has passed.

Jan 04 '24 13:01 CurryRice233

@CurryRice233, thanks for this PR. Apologies for the delay. Most of the team are just returning from the holidays. We will review asap.

Jan 04 '24 16:01 tjruwase

@tjruwase The CI failed. It seems that there is a problem with the CI server. Can you check it?

Jan 05 '24 06:01 CurryRice233

@tjruwase @loadams CI passed again, can you help to review this PR and add to merge queue?

Jan 15 '24 02:01 CurryRice233

@tjruwase @loadams CI passed again, can you help to review this PR and add to merge queue?

@CurryRice233, we will review this asap!

Jan 15 '24 19:01 tjruwase

@mrwyattii Hi, can you add this PR to merge queue, thank you !

Feb 01 '24 07:02 CurryRice233