GongCQ

Results 2 comments of GongCQ

[BUG]: fp32 param and grad have different shape torch.Size([5064704]) vs torch.Size([128000]) when use lora_rank=4 at stage 1

I am having the same issue here

Question about Supervised instructs tuning in ColossalAI/applications/Chat/

get same error