Batch Gradient Descent
From Rice Wiki
In batch gradient descent, the unit of data is the entire dataset, in contrast to Stochastic Gradient Descent whose unit of data is one data point. It uses the average of the computed gradients to update the weights of a batch of data points.
- Faster
- Less performing/precise (not always)
A variation, mini batch GD, uses smaller batches (not the entire dataset). It mitigates the lack in precision.
