View Single Post
Old 05-16-2013, 04:32 PM
htlin's Avatar
htlin htlin is offline
Join Date: Aug 2009
Location: Taipei, Taiwan
Posts: 610
Default Re: Pocket Algorithm and Proof of convergence

Originally Posted by udaykamath View Post
Prof Yaser

Can you suggest paper(s) which refer to pocket algorithm has better convergence or more optimality ?

Having validation set independent and verified at each iteration and keeping the best iteration seems to have some property of convergence as increasing weights below/above changes the dynamics. But i wanted to know if someone has already done some rigorous analysis on that.

Thanks a ton!
Uday Kamath
PhD Candidate
The following paper studies algorithms for the perceptron model from an optimization perspective:

To understand the pocket algorithm, including variants that practically work better than the naive one introduced in the book, a good starting point is its original paper:

Hope this helps.
When one teaches, two learn.
Reply With Quote