ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

amp and Zero bf16 support

Open ht-zhou opened this issue 3 years ago • 2 comments

Support bf16 data type in amp and zero.

ht-zhou avatar Oct 13 '22 07:10 ht-zhou

Hi @ht-zhou , this PR has some conflicts with the main branch, can you fix them first?

FrankLeeeee avatar Oct 13 '22 11:10 FrankLeeeee

Hi @ht-zhou Is this PR still active? There are many conflicts.

binmakeswell avatar Nov 17 '22 11:11 binmakeswell