Arain comments

Repositories
Issues
Comments

Results 2 comments of


                                            Arain

AttributeError: 'DeepSpeedHybridEngine' object has no attribute 'mp_group' in step 3.

> I'll add more details on my experiment: when I'm training 13b, it'll exit raising the aforementioned exception. Commandline (I've finished step1 and step2): > > ``` > $ python3...

TypeError: stack(): argument 'tensors' (position 1) must be tuple of Tensors, not map

I faced the same question.