Quote:
Originally Posted by tcristo
I agree. However, I wouldn't think that would necessarily result in halving the the number of iterations required to converge or result in the "best" answer.

Hinted in my reply is that for PLA in particular, using any positive alpha gives you the same (equivalent) answer with exactly the same number of iterations. So convergencewise, alpha doesn't affect PLA at all.
Not necessarily true for other algorithms, of course.