Rayen comments

Repositories
Issues
Comments

Results 2 comments of


                                            Rayen

feat: LoRA SFT support for DTensorV2 path

Hi, @samodi-nv. I made a few updates on top of your original PR: 1. The convergence issue was caused by the initialization method for lora weight in the automodel. The...

feat: LoRA SFT support for DTensorV2 path

Hi, @ffrujeri. Would you please help review this, especially the tests? I made significant changes to `tests/unit/models/policy/test_dtensor_worker.py`.