Thread: Data snooping
View Single Post
  #2  
Old 11-17-2013, 02:29 AM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Data snooping

Quote:
Originally Posted by cma61 View Post
I still cannot understand the data snooping idea. Does that mean we can't look at the data before we choose the hypothesis set? What about Fig 3.6 in the book?
Sorry for the delay as I am attending to the edX forum this term.

You cannot look at the data and expect the generalization bound you get for the model that you chose based on what you have seen to be valid.

Figure 3.6 is just illustrative of the nonlinear transform process, without worrying about the generalization issues.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote