2019-01-31[Stay Sharp]Lasso Regression and Ridge Regression

Loss function with L2 Regularization:

the model use L2 Regularization is called Ridge Regression

Loss function with L1 Regularization:

the model use L2 Regularization is called Lasso Regression

For Lasso Regression and Ridge Regression, if is zero, then the Loss function will get back to ordinary least square function, and if is very large, the model will under-fit.
the main difference between Lasso Regression and Ridge Regression is that Lasso will remove some less important feature by shrinking its coefficient to zero. which is useful for dataset with a huge number of features.