LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 1 - The Learning Problem

Reply
 
Thread Tools Display Modes
  #1  
Old 01-31-2014, 04:47 PM
netweavercn netweavercn is offline
Junior Member
 
Join Date: Jan 2014
Posts: 7
Default does PLA works for the cases of Non-linear separable

In Page 7, seems PLA has a prerequisite: linear separable. In many cases, usually you have thousands of data points, it is almost impossible to be linear separable because of the noise or maybe the nature is non-linear separable, in this case, does PLA work? if not, any suggestion? i.e. Nerual Network? SVM?
Reply With Quote
  #2  
Old 02-05-2014, 07:17 AM
magdon's Avatar
magdon magdon is offline
RPI
 
Join Date: Aug 2009
Location: Troy, NY, USA.
Posts: 595
Default Re: does PLA works for the cases of Non-linear separable

You can run PLA but it will not converge. A better alternative is the pocket algorithm which you will see in chapter 3. Chapter 3 also describes several other algorithms which can be used for non-separable data, including linear regression, linear programming etc. These are algorithms that stick with the linear model and tolerate errors. The (hard margin) SVM also needs the data to be separable, but you could use the (soft margin) SVM.

The more complex algorithms you mention like neural networks can perform non-linear separation, which can also be accomplished with the linear model and the non-linear transform (see chapter 3).

Quote:
Originally Posted by netweavercn View Post
In Page 7, seems PLA has a prerequisite: linear separable. In many cases, usually you have thousands of data points, it is almost impossible to be linear separable because of the noise or maybe the nature is non-linear separable, in this case, does PLA work? if not, any suggestion? i.e. Nerual Network? SVM?
__________________
Have faith in probability
Reply With Quote
Reply

Tags
pla

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 03:24 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.