simclr icon indicating copy to clipboard operation
simclr copied to clipboard

Optimal value of temperature

Open ines321 opened this issue 4 years ago • 0 comments

For pretrain, I have 5200 images, I would like to know the optimal temperature that I must to use and batch_size, like the official paper says :

the linear evaluation of model trained with three different temperatures under various batch sizes. We find that when training to convergence (e.g. training epochs > 300), the optimal temperature in {0.1, 0.5, 1.0} is 0.5 and seems consistent regardless of the batch sizes. However, the performance with τ = 0.1 improves as batch size increases, which may suggest a small shift of optimal temperature towards 0.1.

So for 5200 images for pretrain , what values of batch_size, epochs, temperature I must use? Thanks

ines321 avatar Jun 15 '21 10:06 ines321