LFD Book Forum Still unclear on Problem 6

#1
01-09-2013, 10:40 AM
 ripande Senior Member Join Date: Jan 2013 Posts: 71
Still unclear on Problem 6

For some reason I am still confused about what question 6 demands. I have read Prof Yaser's reply to the earlier post regarding this question, but I still dont get it.

a). As I understand, a possible target function is the one that agrees with all the 5 points that are stated in the problem.

b). However, the questions says that the possible target functions are 8 ( all permulations of the remaining 3 points with their possible outputs ).

I am unable to relate the above two definitions of the "possible target function".
#2
01-09-2013, 10:55 AM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,477
Re: Still unclear on Problem 6

Quote:
 Originally Posted by ripande a). As I understand, a possible target function is the one that agrees with all the 5 points that are stated in the problem. b). However, the questions says that the possible target functions are 8 ( all permulations of the remaining 3 points with their possible outputs ). I am unable to relate the above two definitions of the "possible target function".
A target function is defined on all 8 points. To be a possible target function given that it generated the data set of 5 points, it has to agree with these points since it generated them. This leaves 3 points which can assume any values and still make the function a possible target function. Since there are 8 possible combinations of values on these 3 points, this gives us 8 distinct functions all of which are possible target functions.
__________________
Where everyone thinks alike, no one thinks very much
#3
01-09-2013, 02:23 PM
 butterscotch Caltech Join Date: Jan 2013 Posts: 43
Re: Still unclear on Problem 6

Let's say the hypothesis is "returns 0 for all three points".
The following target function is defined on 8 points, agrees with the hypothesis, and agrees with D.
[ x_n; y_n]
[0,0,0;0]
[0,0,1;1]
[0,1,0;1]
[0,1,1;0]
[1,0,0;1]
[1,0,1;0]
[1,1,0;0]
[1,1,1;0]

---------------------------------------------
[ x_n; y_n]
[0,0,0;0]
[0,0,1;0]
[0,1,0;1]
[0,1,1;0]
[1,0,0;1]
[1,0,1;0]
[1,1,0;0]
[1,1,1;0]

also agrees with the hypothesis, but it does not agree with D, hence not one of the 8 target functions.
#4
01-11-2013, 12:23 AM
 ripande Senior Member Join Date: Jan 2013 Posts: 71
Re: Still unclear on Problem 6

Understood. :-) Thanks Prof Yaser and Butterscotch

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 02:30 PM.