ml-fastvit icon indicating copy to clipboard operation
ml-fastvit copied to clipboard
verified publisher icon apple

activation in ReparamLargeKernelConv is not used

Open leondgarse opened this issue 2 years ago • 2 comments

activation in ReparamLargeKernelConv is actually not used, and the code there is confusing. Please help make sure if this is intend to be, or a bug.

leondgarse avatar Aug 19 '23 10:08 leondgarse

heh, also just noticed this :) curious what impact it may have as I doubt it was intentional

rwightman avatar Aug 22 '23 18:08 rwightman

Hehe, I was just noticed it... I got 0.2% better accuracy with the corrected activation (not on ImageNet).

hassonofer avatar Sep 23 '24 13:09 hassonofer