LFD Book Forum  

Go Back   LFD Book Forum > Course Discussions > Online LFD course > Homework 4

Reply
 
Thread Tools Display Modes
  #1  
Old 08-04-2012, 12:43 PM
samirbajaj samirbajaj is offline
Member
 
Join Date: Jul 2012
Location: Silicon Valley
Posts: 48
Default Conflicting Lessons?

Dear Professor:

(I have asked stupid questions before, but I have no shame, so in that spirit, here's another one )

Can you please help me reconcile the following two lessons:


1) Lecture 8 - slide 16 - "Lesson Learned" - Match model complexity to data resources

2) Lecture 9 - slide 8 - "Lesson Learned" - Looking at data before choosing your model can be hazardous


Thank you in advance.

-Samir
Reply With Quote
  #2  
Old 08-06-2012, 10:31 PM
Mayson Lancaster Mayson Lancaster is offline
Junior Member
 
Join Date: Jul 2012
Posts: 7
Default Re: Conflicting Lessons?

Actually, it seems that the two do not quite conflict.

The first lesson: match model complexity to data resources, means that you vary the complexity of your model based on how much data you have [perhaps employing a heuristic such as N = 10*dvc or dvc = N/10]

The second says that you should not look at the data itself, not merely the amount of data, but the fine structure, distribution, features, etc.

(I'd be glad to get feedback from course staff as to how well my attempted explanation gets at the meaning of the two sayings.)
Reply With Quote
  #3  
Old 08-06-2012, 11:43 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Conflicting Lessons?

Quote:
Originally Posted by Mayson Lancaster View Post
Actually, it seems that the two do not quite conflict.

The first lesson: match model complexity to data resources, means that you vary the complexity of your model based on how much data you have [perhaps employing a heuristic such as N = 10*dvc or dvc = N/10]

The second says that you should not look at the data itself, not merely the amount of data, but the fine structure, distribution, features, etc.

(I'd be glad to get feedback from course staff as to how well my attempted explanation gets at the meaning of the two sayings.)
The feedback from the course staff is positive.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #4  
Old 08-07-2012, 01:02 PM
gah44 gah44 is offline
Invited Guest
 
Join Date: Jul 2012
Location: Seattle, WA
Posts: 153
Default Re: Conflicting Lessons?

I presume in this case "look" means a computer looked at the data.

Probably worse if a person looks at the data. People are very good at finding patterns, even if there isn't one, and, even worse, remembering patterns from previous (unrelated) data sets and applying them.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 11:13 PM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.