View Single Post
  #2  
Old 10-15-2012, 07:39 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,478
Default Re: Regression then PLA

Quote:
Originally Posted by gah44 View Post
In the Homework 1 section there is discussion showing that PLA is
independent of alpha, as only the ratio to w0 counts.

It seems, though, when using regression before PLA, as
initial weights for the PLA, that alpha is important again.

Too big, and the initial weights don't do much, too small
and it converges slow.
Good point.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote