DeepSpeed
DeepSpeed copied to clipboard
Update profiler.py
assume one flop equals two macs
@gameofdimension can you elaborate more on this PR and why one flop is 2 macs, usually 1 mac is 2 flops?
@gameofdimension can you elaborate more on this PR and why one flop is 2 macs, usually 1 mac is 2 flops?
Hi @gameofdimension - any thoughts on this PR? I'm going to close it for now, but please comment and we can re-open and discuss changes here.