[FEA][Inductor-EVT] tanh, sigmoid, exp, gelu are not supported in python evt tracer

[mlazos]

Is your feature request related to a problem? Please describe. It looks like relu is the only activation function supported by the evt tracer, but I do see other implementations in https://github.com/NVIDIA/cutlass/blob/ad7b2f5e84fcfa124cb02b91d5bd26d238c0459e/python/cutlass/backend/epilogue.py#L429

repro for tanh

Describe the solution you'd like I think these just need to be added to the op mapping in the AST. I would like these to be supported by the python tracer.

Describe alternatives you've considered I think I may possibly do this myself in inductor by adding those implementations to the map.

@thakkarV, @henrylhtsang, @mnicely, @eellison

[hwu36]

@jackkosaian , @apuaaChen

could you please take a look?

[mlazos]

Also just fyi- I could get by with just exp and use decompositions to get the others so perhaps prioritize that first?

[github-actions[bot]]

This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.

[apuaaChen]

Hi! The issue should be solved by 4.1. You can find the unit tests here: https://github.com/NVIDIA/cutlass/blob/main/test/python/cutlass/evt/evt_compute_sm80_90.py#L121

[mlazos]

Added tests into PyTorch, this works thanks!