Ridge regression

From Rice Wiki
Revision as of 19:58, 18 May 2024 by Rice (talk | contribs) (Rice moved page Ridge Regression to Ridge regression)

Ridge regression is a regression model with an additional term called the regularizer. The motive for this model is to discourage overfitting. It is similar to Regularization, except it more heavily punishes complex models.

Regularizer

The regularizer Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \lambda} is an additional term to the loss function that penalizes higher order terms.

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \lambda \sum \left| w_j^2 \right|}