Specformer icon indicating copy to clipboard operation
Specformer copied to clipboard

Question about Small and medium model for graph classification

Open Dbgsaoge opened this issue 1 year ago • 1 comments

Hi, I am interested in your work. But I have a question about your medium_model.py; it seems that in your SpecformerMedium class, you didn't apply
``` mha_eig = self.mha_norm(eig) mha_eig, attn = self.mha(mha_eig, mha_eig, mha_eig, key_padding_mask=e_mask) eig = eig + self.mha_dropout(mha_eig)

    ffn_eig = self.ffn_norm(eig)
    ffn_eig = self.ffn(ffn_eig)
    eig = eig + self.ffn_dropout(ffn_eig)
     ```

the encoding process. Instead, you directly apply decoder to the EE representation. Is it the right process?

Dbgsaoge avatar Jul 20 '24 17:07 Dbgsaoge

Hi, thanks for your interest!

I comment these codes for ablation studies and forget to uncomment them.

Feel free to use these codes directly.

bdy9527 avatar Oct 07 '24 02:10 bdy9527