Some questions about the projection head.

[ToaTao]

Hi, thank you very much for your code. But I have a doubt about the projection head. I think there should be two BN layers i.e. linear layer , BN , relu, linear layer, BN. I don't know if this should be the case, and how much impact the lack of BN layer has on the performance of the model. look forward to your reply. Thanks again.