Vivek

Results 5 comments of Vivek

[BUG] RuntimeError: inflight params error when using DeepSpeed for Reinforcement Learning

I am facing the same issue. Can anyone help?

[BUG] RuntimeError: inflight params error when using DeepSpeed for Reinforcement Learning

I was trying RL using trl on T5 (Seq2Seq) Model with PEFT, and facing this issue with zero stage 3. It was working fine with stage 2. Can anyone help...

[BUG] deepspeed-chat bloom training error, raise RuntimeError "still have inflight params " after 14 steps training of step3 with offload option turned on

I am facing the same issue: Does anyone help me in this issue?

[BUG] deepspeed-chat bloom training error, raise RuntimeError "still have inflight params " after 14 steps training of step3 with offload option turned on

> @loadams - please see if this is connected to #3735 Yes it is connected to this issue. Can you help me with this issue?

[QUESTION] How to figure out correct `injection_policy` for Flan-T5

Has anyone been able to determine the correct injection_policy for Flan-UL2, or is it confirmed whether this policy is supported or unsupported for Flan-UL2?