View Single Post
Old 04-10-2013, 12:26 PM
Rahul Sinha Rahul Sinha is offline
Junior Member
Join Date: Apr 2013
Posts: 9
Default Re: Regression then PLA

Originally Posted by Michael Reach View Post
Huh - I haven't done this problem yet, but this is really interesting. I had thought the answer to this question would be, like, 1, but now I see that the first step is likely to ruin the advantage that the linear regression gave you. The PLA isn't initially very subtle; the weights eventually get big and you have to wait till the size of the adjustments becomes small relative to the weights for the fine tuning.

For 10 data points, it might very well converge quickly! My simulation converges at the speed of light!
1000 data points is another story.
Reply With Quote