About the feature vectors from teacher and student

Open ccccly opened this issue 3 years ago • 1 comments

Dear author,

I am confused about the feature vectors used in contrastive learning. The teacher's feature vectors are simply obtained using the projection head g. Why use the projection head g and the prediction head q to obtain the feature vectors of student? Can we just use only g in the student model?

Jul 14 '22 10:07 ccccly

I also have the same question as you. Do you understand now? Can you share it with me?

Sep 14 '23 03:09 DaD3zZ