LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   The Final (http://book.caltech.edu/bookforum/forumdisplay.php?f=138)
-   -   Clarification – Data Snooping and Tukey’s EDA (http://book.caltech.edu/bookforum/showthread.php?t=4344)

ckimbrough 06-10-2013 08:30 PM
Clarification – Data Snooping and Tukey’s EDA
 
In John Tukey’s book “EDA” (Exploratory Data Analysis) we learn to use descriptive visual devices such as “stem and leaf” plots, box plots, smoothing sequences, etc.

These things require a lot of rooting around in the data set, is EDA data snooping? Or is it only data snooping if you let what EDA reveals about the data guide you to a specific hypothesis?

yaser 06-10-2013 08:37 PM
Re: Clarification – Data Snooping and Tukey’s EDA
 
Quote:
Originally Posted by ckimbrough (Post 11093)
Or is it only data snooping if you let what EDA reveals about the data guide you to a specific hypothesis?
This is the essence of data snooping; affecting the choice of hypothesis without accounting for that in terms of expected generalization.

ckimbrough 06-10-2013 08:53 PM
Re: Clarification – Data Snooping and Tukey’s EDA
 
Thank you Professor, I needed to relate it to something I know. Snooping will be difficult to realize you are doing, but I will always keep it in mind.

Thank you for all your efforts in this excellent and thoughtful course. I believe I am on my way now!


All times are GMT -7. The time now is 02:51 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.