contentvec icon indicating copy to clipboard operation
contentvec copied to clipboard
verified publisher icon auspicious3000

Contrastive loss weights

Open jingru-lin opened this issue 2 years ago • 1 comments

According to the paper, the contrastive loss weight is set to 1e-5 * num_train_steps.

However, in the given config, the 'loss_weights: [10,1]', where 1 is the contrastive loss weight.

May I know why?

jingru-lin avatar Apr 17 '23 12:04 jingru-lin

The run.sh will override the config.

auspicious3000 avatar Apr 17 '23 14:04 auspicious3000