#1




Intuition of the step of PLA
According to the book, the update rule for PLA is w(t+1) = w(t) + y(t)x(t), and the book mentions "this rule moves the boundary in the direction of classifying x(t) correctly".
I understand that there is a convergence proof for PLA. But it is hard for me to see why such rule (or step) moves the boundary in the direction of classifying x(t) correctly. The formula just adds actual outcome (i.e. y(t)) times the misclassified point (i.e. x(t)) to the current weight matrix (which is just a vector of coefficient of hypothesis equation). Any pointer will help. Thanks in advance! 
#2




Re: Intuition of the step of PLA
The point would be correctly classified if agreed in sign with . Therefore, moving in the direction of agreeing with that sign would be moving it in the right direction.
Adding to will indeed achieve that, since it will add to the quantity and what it adds agrees with in sign since the part is always positive.
__________________
Where everyone thinks alike, no one thinks very much 
#3




Re: Intuition of the step of PLA
Quote:
It works but I'm concerned I'm updating weights with a rule that is "not so smart":
To summarize my questions:

#4




Re: Intuition of the step of PLA
Quote:
Just a bit hard to visualize it. 
Thread Tools  
Display Modes  

