lichao comments

Results 8 comments of


                                            lichao

[BUG]KeyError: 'attention_mask'

> Hi @janglichao, can you please provide more information about your setup? > > ds_report output Please run ds_report to give us details about your setup. > > System info...

[BUG]No module named 'colossalai._C.cpu_adam':

same problem, can anyone help!!!

[BUG]No module named 'colossalai._C.cpu_adam':

same problem, can anyone help!!!

Can not train llama-7b due to OOM on 40GA100

same problem!!! can official team solve this bug ASAP!!!!

commerical use

> thanks。

关掉Lora微调大模型，模型并行训练报错：Expected all tensors to be on the same device, but found at least two devices, cuda:3 and cuda:0!

我也遇到这个bug，怎么解决啊，在线蹲个方案

Tesla V100 32GB 运行finetuning_lora.py 报错：torch.cuda.OutOfMemoryError: CUDA out of memory

3090 *2 两张3090也遇到cuda溢出的问题了，用的lora，请问怎么解决

RuntimeError: The size of tensor a (2048) must match the size of tensor b (4241) at non-singleton dimension 1

> I'm assuming it's something to do with the max sequence length? +1, I also got same error,pls help Name Version Build Channel unsloth 2025.2.12 pypi_0 pypi unsloth-zoo 2025.2.5 pypi_0...