1485840691-eng
Results
2
comments of
1485840691-eng
Hi, maybe I could help take IRPO following https://arxiv.org/pdf/[2404.19733] and https://github.com/huggingface/trl/issues/1611. Based on the paper, it could follow DPO Liger support and add DPO + NLL loss. Any suggestions on...
> Make sure you do `make precommit` Done precommit check. Please help review. Thanks