LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 1 - The Learning Problem

Reply
 
Thread Tools Display Modes
  #1  
Old 04-20-2014, 06:00 PM
netweavercn netweavercn is offline
Junior Member
 
Join Date: Jan 2014
Posts: 7
Default Exercise 1.7

A little confused about 1.7. what is the purpose of this exercise: learning is impossible?

in (a), both hypotheses have 1 agree on all 3 points and no agree on all other 7 cases. so which hypothesis should be chose by learning algorithm? as the 2 hypotheses are the same.

in(b), still same situation

in(c), there are 4 cases agrees.

(d), is it possible to agree all 8 cases?
Reply With Quote
  #2  
Old 04-21-2014, 12:21 PM
magdon's Avatar
magdon magdon is offline
RPI
 
Join Date: Aug 2009
Location: Troy, NY, USA.
Posts: 595
Default Re: Exercise 1.7

The purpose of the exercise is to show what can possibly happen outside the data, namely anything, and it is the same no matter how you pick your g from the data.

Compare this with the bin in the next section. What can possibly remain in the bin after you pick your sample is every possible combination of red and green marbles.

So it is always *possible* to end up with a hypothesis that is arbitrarily bad no matter what algorithm you use to pick that hypothesis using only the data as a guide. That is what thiis exercise illustrates. In the next section you will learn that while anything is possible, some things are more likely than others.

Quote:
Originally Posted by netweavercn View Post
A little confused about 1.7. what is the purpose of this exercise: learning is impossible?

in (a), both hypotheses have 1 agree on all 3 points and no agree on all other 7 cases. so which hypothesis should be chose by learning algorithm? as the 2 hypotheses are the same.

in(b), still same situation

in(c), there are 4 cases agrees.

(d), is it possible to agree all 8 cases?
You may have misunderstood the question. In (a) you pick the hypothesis that is always \bullet, since that is what agrees with the data the most (from the table on the same page). Compare this g with the possible choices for f given by f_1,\ldots,f_8: 1 agrees with g on all three test points; 3 agree with g on two test points; 3 agree with g on one test points; 1 agrees with g on none of the test points;
__________________
Have faith in probability
Reply With Quote
  #3  
Old 04-22-2014, 05:03 PM
netweavercn netweavercn is offline
Junior Member
 
Join Date: Jan 2014
Posts: 7
Default Re: Exercise 1.7

Thanks a lot, so for (a), whatever you choose which h (white or black), the result is the same.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 03:39 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.