Chris (Tu) NGUYEN

Hi @rohan-varma , I'm also having the same problem with full fine-tuning (fp32) on 8xV100 (32GB) - activation checkpointing enabled - FSDP: FULL_SHARD - batch_size = 1 Training can still...

i have same problem trying to fine-tune MiniCPM V2.6 with ds zero3. Please advice! ``` return F.conv2d(input, weight, bias, self.stride, RuntimeError: weight should have at least three dimensions ```

> In V2.6 we can (which is awesome!) Hi @Mihaiii , can you advise how to fine-tune with multiple images in V2.6, I'm struggling to see how to do it?...

@Mihaiii In this thread https://github.com/OpenBMB/MiniCPM-V/issues/386, @qyc-98 has commented this will be supported in near future, so I assume it's not supported now

looks like latest commit enables support for multi-image fine-tuning, I will give it a try https://github.com/OpenBMB/MiniCPM-V/commit/cd64150b5122f8ee8c677d481c97918485129b52