LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 1 - The Learning Problem (http://book.caltech.edu/bookforum/forumdisplay.php?f=108)
-   -   does PLA works for the cases of Non-linear separable (http://book.caltech.edu/bookforum/showthread.php?t=4470)

netweavercn 01-31-2014 04:47 PM

does PLA works for the cases of Non-linear separable
 
In Page 7, seems PLA has a prerequisite: linear separable. In many cases, usually you have thousands of data points, it is almost impossible to be linear separable because of the noise or maybe the nature is non-linear separable, in this case, does PLA work? if not, any suggestion? i.e. Nerual Network? SVM?

magdon 02-05-2014 07:17 AM

Re: does PLA works for the cases of Non-linear separable
 
You can run PLA but it will not converge. A better alternative is the pocket algorithm which you will see in chapter 3. Chapter 3 also describes several other algorithms which can be used for non-separable data, including linear regression, linear programming etc. These are algorithms that stick with the linear model and tolerate errors. The (hard margin) SVM also needs the data to be separable, but you could use the (soft margin) SVM.

The more complex algorithms you mention like neural networks can perform non-linear separation, which can also be accomplished with the linear model and the non-linear transform (see chapter 3).

Quote:

Originally Posted by netweavercn (Post 11635)
In Page 7, seems PLA has a prerequisite: linear separable. In many cases, usually you have thousands of data points, it is almost impossible to be linear separable because of the noise or maybe the nature is non-linear separable, in this case, does PLA work? if not, any suggestion? i.e. Nerual Network? SVM?



All times are GMT -7. The time now is 08:23 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.