LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 1 - The Learning Problem (http://book.caltech.edu/bookforum/forumdisplay.php?f=108)
-   -   does PLA works for the cases of Non-linear separable (http://book.caltech.edu/bookforum/showthread.php?t=4470)

 netweavercn 01-31-2014 03:47 PM

does PLA works for the cases of Non-linear separable

In Page 7, seems PLA has a prerequisite: linear separable. In many cases, usually you have thousands of data points, it is almost impossible to be linear separable because of the noise or maybe the nature is non-linear separable, in this case, does PLA work? if not, any suggestion? i.e. Nerual Network? SVM?

 magdon 02-05-2014 06:17 AM

Re: does PLA works for the cases of Non-linear separable

You can run PLA but it will not converge. A better alternative is the pocket algorithm which you will see in chapter 3. Chapter 3 also describes several other algorithms which can be used for non-separable data, including linear regression, linear programming etc. These are algorithms that stick with the linear model and tolerate errors. The (hard margin) SVM also needs the data to be separable, but you could use the (soft margin) SVM.

The more complex algorithms you mention like neural networks can perform non-linear separation, which can also be accomplished with the linear model and the non-linear transform (see chapter 3).

Quote:
 Originally Posted by netweavercn (Post 11635) In Page 7, seems PLA has a prerequisite: linear separable. In many cases, usually you have thousands of data points, it is almost impossible to be linear separable because of the noise or maybe the nature is non-linear separable, in this case, does PLA work? if not, any suggestion? i.e. Nerual Network? SVM?

 All times are GMT -7. The time now is 01:07 AM.