query2labels icon indicating copy to clipboard operation
query2labels copied to clipboard

Code for visualization of multi-head attention maps

Open myt889 opened this issue 4 years ago • 1 comments

Hi Liu, Thank for your great work and sharing clean code. Can you share your visualization code of multi-head attention maps,I am new to transformer, and find it difficult to realize this. Hope for your help.

Best Regards! Tan

myt889 avatar Mar 07 '22 14:03 myt889

Hi Liu, I am also very interested in the visualization method, which helps improve the interpretability of the model. Can you share the code for this part? Looking forward to your update!

Best Regards! Rui

UCASHurui avatar May 17 '22 03:05 UCASHurui