Batch Gradient Descent: Difference between revisions
From Rice Wiki
(Created page with "In '''batch gradient descent''', the unit of data is the entire dataset, in contrast to Stochastic Gradient Descent whose unit of data is one data point. It uses the ''average of the computed gradients'' to update the weights of a ''batch'' of data points. * Faster * Less performing/precise (not always)") |
No edit summary |
||
| Line 3: | Line 3: | ||
* Faster | * Faster | ||
* Less performing/precise (not always) | * Less performing/precise (not always) | ||
A variation is to use smaller batches (not the entire dataset). It mitigates the lack in precision. | |||
Revision as of 18:28, 15 April 2024
In batch gradient descent, the unit of data is the entire dataset, in contrast to Stochastic Gradient Descent whose unit of data is one data point. It uses the average of the computed gradients to update the weights of a batch of data points.
- Faster
- Less performing/precise (not always)
A variation is to use smaller batches (not the entire dataset). It mitigates the lack in precision.
