LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 5 - Three Learning Principles (http://book.caltech.edu/bookforum/forumdisplay.php?f=112)
-   -   Data snooping versus explorative data analysis (http://book.caltech.edu/bookforum/showthread.php?t=9564)

gverhoev 07-09-2021 05:37 PM

Data snooping versus explorative data analysis
If looking at the data before deciding upon the hypothesis set is data snooping, what is then the point of explorative data analysis in statistics?

htlin 07-11-2021 01:00 AM

Re: Data snooping versus explorative data analysis
P16 here


provides a more practical view about dealing with data snooping. Explorative data analysis, data-driven modeling, or many other techniques may suffer from data snooping. Nevertheless, if we can try to be cautious/professional such that the pros (modeling better) are more than the cons (data snooping), those techniques can be helpful.

Hope this helps.

All times are GMT -7. The time now is 01:13 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.