View Single Post
Old 01-09-2013, 12:24 PM
Anne Paulson Anne Paulson is offline
Senior Member
Join Date: Jan 2013
Location: Silicon Valley
Posts: 52
Default Re: PLA: Is randomly selecting the update important?

No, the algorithm will always converge eventually if there is linear separation, no matter how you pick the misclassified point. And the proof isn't that difficult.

But now we have one person in one thread saying that they found picking the points at random gave better results, and another person in another thread saying picking the first misclassified point gave better results. Mysterious.

My strategy would be to start with the last misclassified point, the one I just updated with; try it again if it is still misclassified, and then pick the next misclassified point in the list.
Reply With Quote