LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 4 - Overfitting

Reply
 
Thread Tools Display Modes
  #1  
Old 11-09-2013, 12:56 PM
cma61 cma61 is offline
Junior Member
 
Join Date: Nov 2013
Posts: 3
Default Data snooping

I still cannot understand the data snooping idea. Does that mean we can't look at the data before we choose the hypothesis set? What about Fig 3.6 in the book?
Reply With Quote
  #2  
Old 11-17-2013, 02:29 AM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,475
Default Re: Data snooping

Quote:
Originally Posted by cma61 View Post
I still cannot understand the data snooping idea. Does that mean we can't look at the data before we choose the hypothesis set? What about Fig 3.6 in the book?
Sorry for the delay as I am attending to the edX forum this term.

You cannot look at the data and expect the generalization bound you get for the model that you chose based on what you have seen to be valid.

Figure 3.6 is just illustrative of the nonlinear transform process, without worrying about the generalization issues.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
Reply

Tags
data snooping, model selection

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 01:40 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.