Home / Deep learning / Automatic differentiation
Pros and cons
Pros:
- fast execution
- exact results 1
Cons:
- requires prior evaluation and caching of itermediate results
- no symbolic representation of the derivative
Footnotes:
1
Ignoring e.g. floating point precision loss.