Analytical GradientsIt is a method for calculating parameter gradients, usually referring to the use of back propagation to calculate the parameter gradients of the objective function in a neural network algorithm.

There are currently two main ways to calculate gradients:

• Numerical Gradient
• Analytic Gradient