- **Chapter 3 - The Linear Model**
(*http://book.caltech.edu/bookforum/forumdisplay.php?f=110*)

- - **PLA vs Linear Regression**
(*http://book.caltech.edu/bookforum/showthread.php?t=310*)

PLA vs Linear RegressionCan we ask week 2 lecture questions on the Linear Model here?
Building a Perceptron classifier in the week 1 homework helped me see how the weight vector, w, defines the decision boundary (or line). For two-dimensional input, w0 + w1*x1 + w2*x2 = 0 is the equation for the decision line. But when doing linear regression it is more like fitting a (hyper-)line to data points, which seems orthogonal to a decision boundary. I'm confused on how to reconcile these points of view. Does training w with PLA yield roughly the same results as training w using linear regression in which the y values are set to -1,1 for the two classes? Here's what I'm thinking so far: Maybe linear regression with x1, x2, and y={-1,1} finds the equation of a plane that 'passes through' _all_ of the data best (in the least squares sense), _not_ a plane that separates the two classes. Then where the plane passes through y=0, maybe that would be similar to the line found from PLA. But if this interpretation is right, wouldn't the w vector for linear regression have 4 numbers for this example (so it defines a plane), whereas w for PLA only had three? (If this view is right then I can see how, as mentioned in class, the spread of training examples further away pull the plane towards that class, moving the decision line further into that class in an unwanted way...) |

All times are GMT -7. The time now is 08:34 PM. |

Powered by vBulletin® Version 3.8.3

Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.

The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.