View Single Post
  #2  
Old 05-06-2013, 02:06 AM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,478
Default Re: Q7 - understanding co-ordinate descent

Quote:
Originally Posted by bargava View Post
I didn't entirely understand what co-ordinate descent meant. This is what I believe it to be: Instead of descending "simultaneously" along all the co-ordinates as in gradient descent(in this eg: both u and v), we first descend along u, find the new u and then find v. So, when computing v, the new value of u is to be used. Am I right?
Correct. After each update along one coordinate, you compute the derivative at the new point, then descend along the other coordinate. This is not an efficient method, and is meant for comparison with gradient descent.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote