Ridge regression

Ridge regression is a regression model with an additional term called the regularizer. The motive for this model is to discourage overfitting. It is similar to Regularization, except it more heavily punishes complex models.

Regularizer

The regularizer $\lambda$ is an additional term to the loss function that penalizes higher order terms.

$\lambda \sum \left|w_{j}^{2}\right|$