DeepSpeed
DeepSpeed copied to clipboard
[BUG]what's the minimal requirement for running DeepSpeed-Chat
I am running DeepSpeed-Chat 1.6B with 4*V100 16G GPU, reducing batch size to 1, passing step 1 and 2. However, I am not able to pass step 3. Am I matching the minimal hardware requirement?