Batch Gradient Descent

In batch gradient descent, the unit of data is the entire dataset, in contrast to Stochastic Gradient Descent whose unit of data is one data point. It uses the average of the computed gradients to update the weights of a batch of data points.

• Faster
• Less performing/precise (not always)

A variation is to use smaller batches (not the entire dataset). It mitigates the lack in precision.