Kang-Jun(KJ) Liu issues

Repositories
Issues
Comments

Results 2 issues of


                                            Kang-Jun(KJ) Liu

Customization of BlockDiagonalMask or BlockDiagonalCausalMask

# ❓ Questions and Help I am trying to write a customization of BlockDiagonalMask with an additional variable `group_lengths_list`. Inside each block, tokens are separated into 3 groups (number of...

[LOCA] Projection head pre-trained weights in loca_vbase_imnet1k are almost zeros. Is this a correct behavior?

Hi, In project LOCA, I found the pre-trained weights of the projection head are almost zeros. The minimum reproducible code with the downloaded checkpoint is as below. ``` import numpy...