View Single Post
  #1  
Old 09-11-2016, 12:04 AM
ntvy95 ntvy95 is offline
Member
 
Join Date: Jan 2016
Posts: 37
Default How does regularized logistic regression regularize perceptron model?

In the case I use regularized logistic regression to train perceptron model with threshold \frac{1}{2}, for regularized logistic regression it means that I have had soft-order constraint on w, however for perceptron model, as suggested in Exercise 4.6, it looks like soft-order constraint on w doesn't regularize perceptron model at all. Meanwhile in practice, I see that regularized logistic regression does regularize perceptron model and Andrew Ng's online course also suggests that regularized logistic regression fights against overfitting on classification problems.

What did I miss here?

Thank you very much in advance.
Reply With Quote