opacus icon indicating copy to clipboard operation
opacus copied to clipboard

Einsum optimization

Open ffuuugor opened this issue 3 years ago • 1 comments

A lot of our grad sample computations are based on einsum. There's an easy (one-liner) way to optimize the expression: https://optimized-einsum.readthedocs.io/en/stable/

We want to try this and evaluate the impact

ffuuugor avatar Mar 11 '22 14:03 ffuuugor

Small update: now that we have benchmarks available, there's an easy way to evaluate the impact of this optimization.

See this guide on how to run benchmarks.

ffuuugor avatar Apr 26 '22 14:04 ffuuugor