Gradient Descent
From Rice Wiki
How it works
After processing all data points, all weights are updated and 1 epoch is completed.
GD Update Rule
The GD update rule is used to update the weights after an iteration.
LMS
Least-mean-squared is a GD update rule.