View Single Post
  #3  
Old 08-06-2012, 11:43 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Conflicting Lessons?

Quote:
Originally Posted by Mayson Lancaster View Post
Actually, it seems that the two do not quite conflict.

The first lesson: match model complexity to data resources, means that you vary the complexity of your model based on how much data you have [perhaps employing a heuristic such as N = 10*dvc or dvc = N/10]

The second says that you should not look at the data itself, not merely the amount of data, but the fine structure, distribution, features, etc.

(I'd be glad to get feedback from course staff as to how well my attempted explanation gets at the meaning of the two sayings.)
The feedback from the course staff is positive.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote