Ridge Regression

Ridge regression is a regression method used for “shrinkage”, which is the practice of attenuating the effect of certain regressors through their coefficients.

Let’s first consider the standard linear regression objective function:

\[\]