View Single Post
  #3  
Old 05-06-2013, 08:28 PM
Ziad Hatahet Ziad Hatahet is offline
Member
 
Join Date: Apr 2013
Location: San Francisco, CA
Posts: 23
Default Re: HW5 Q9: SGD and Epochs?

Quote:
Originally Posted by yaser View Post
Correct. You should average the number of epochs rather than the number of single-point SGD iterations. The termination criterion necessitates that you finish whole epochs.
But if we will be making an entire pass over all data points in each iteration before checking the termination condition, how is this cheaper than batch GD?

Edit: I just saw the discussion here: http://book.caltech.edu/bookforum/showthread.php?t=458.

Thanks Prof. Yaser
Reply With Quote