ADTypes.jl icon indicating copy to clipboard operation
ADTypes.jl copied to clipboard
verified publisher icon SciML

Support `Zygote.forwarddiff` & `Zygote.checkpointed`

Open prbzrg opened this issue 2 years ago • 1 comments

Hi, I have a question, do we need to support Zygote.forwarddiff? What about Zygote.checkpointed? I think, there can be parameters of AutoZygote to activate them.

prbzrg avatar Aug 15 '23 03:08 prbzrg

  • Supporting Zygote.forwarddiff seems weird to me, because if you really need to differentiate a function with ForwardDiff.jl you will use AutoForwardDiff
  • Supporting Zygote.checkpointed seems reasonable, and it could be a field checkpointed::Bool of AutoZygote in the same way that e.g. AutoReverseDiff has compile::Bool. A type parameter would seem more type-stable, but given how unstable Zygote.jl itself is, I don't know if it matters. @Vaibhavdixit02, any idea?

gdalle avatar Apr 16 '24 06:04 gdalle