Quote:
Originally Posted by tcristo
I agree. However, I wouldn't think that would necessarily result in halving the the number of iterations required to converge or result in the "best" answer.
|
Hinted in my reply is that for PLA in particular, using any positive alpha gives you the same (equivalent) answer with exactly the same number of iterations. So convergence-wise, alpha doesn't affect PLA at all.
Not necessarily true for other algorithms, of course.