TDSM 11.3
From The Data Science Design Manual Wikia
Regularization is a technique used in an attempt to solve the overfitting problem in statistical models. (from Wikipedia)
Textbook page 286: regularization is the trick of adding secondary terms to the objective function to favor models that keep coefficient small.
Edit: It punishes larger coefficients
