Kyeongryeol Go

icon indicating an email [email protected]

icon location Seoul icon location Hi, I’m Kyeongryeol, a Machine Learning Engineer in Superb AI.

Results 1 comments of Kyeongryeol Go

[ORPO] add the log odds part to the loss

@sayakpaul Shouldn't the log_odds be `-(model_losses_w - model_losses_l)`? Referring the pdf of gaussian distribution, `log_prob` is akin to `-mse` not `mse`.