Question: How does ridge regression work?
My answer: OLS models are BLUE – best linear unbiased estimateors.
But sometimes forcing unbiasedness causes other problems. In particular, if the independent variables are fairly collinear, then the variances of the parameter estimates will be huge and small differences in the input data can make huge differences in the parameter estimates.
Ridge regression allows some bias in order to lower the variance.