Cedarch

BF16 training for DINOv3 gives significantly worse accuracy than FP32.

8

I'm fine-tuning DINOv3 on my custom dataset. When I train with FP32, I get good results, but with BF16, the accuracy is significantly worse. I did not observe this same...