YiSheng5 issues

Repositories
Issues
Comments

Results 4 issues of


                                            YiSheng5

Fix a type error on bf16+Pipeline Parallelism

Hi, when verified ZeRO 1 support to PP for BF16, found a typo error, the ZeroStageEnum().gradients should be fixed to ZeroStageEnum.gradients to get the value, can limit the zero_stage less...

[manifest] update mainfest to add hpp file in csrc.

Update the mainfest to cover hpp file in csrc.

[manifest] update mainfest to add hpp file in deepspeed.

Hi @loadams, Could you please help to review this pr? After add hpp files in csrc, we found sometimes the hpp headers will still be excluded from the op src...

[NaN check] Add NaN check to support bfloat16.