simclr
simclr copied to clipboard
Optimal value of temperature
For pretrain, I have 5200 images, I would like to know the optimal temperature that I must to use and batch_size, like the official paper says :
the linear evaluation of model trained with three different temperatures under various batch sizes. We find that when training to convergence (e.g. training epochs > 300), the optimal temperature in {0.1, 0.5, 1.0} is 0.5 and seems consistent regardless of the batch sizes. However, the performance with τ = 0.1 improves as batch size increases, which may suggest a small shift of optimal temperature towards 0.1.
So for 5200 images for pretrain , what values of batch_size, epochs, temperature I must use? Thanks