View Single Post
Old 07-17-2012, 09:06 AM
Randy Randy is offline
Junior Member
Join Date: Jul 2012
Posts: 3
Default Re: Perceptron: should w_0 (bias) be updated?

Yeah, I saw the same thing as I kept experimenting with it.

So the problem is that w0 does a random walk over the integers, without ever converging to a meaningful value, at least if you use a starting value of 0.

Since w1 and w2 determine the orientation of the dividing line between the positive and negative points, and w0 determines it's location relative to the origin, it seems to me that this update rule can never find a good solution if the true dividing line does not pass through (x1=0,x2=0).
Reply With Quote