torchscope
torchscope copied to clipboard
Confusion about FLOPs and Madds.
I think FLOPs ≈ 2 * MAdds as general each MAdd contains one multiplication and one addition, but the result of your code is not like this.