Difference between refs and ref_values

Open coconut0012 opened this issue 2 years ago • 1 comments

Dear author,

I do not understand the difference between refs and ref_values. Can you tell me their difference?

https://github.com/FoundationVision/UniRef/blob/e339305039ffaa5500a25e34cf6a0677c109a2c9/projects/UniRef/uniref/models/fuse_helper/unifusion.py#L79

Jan 24 '24 14:01 coconut0012

In the QKV attention, ref plays the role of K and ref_values is V.

For the RVOS task, ref and ref_values are the same which come from the text features. For the VOS task, ref is from image features and ref_values is from image+mask features.

Mar 12 '24 15:03 wjn922