Error if given nonfinite primal?

[oxinabox]

We can't really do finite differencing around Inf or NaN can we?

[mzgubic]

It's fine to get it a NaN as a primal input if it's marked as non differentiable right?

[oxinabox]

Correct