LFD Book Forum HW 4 question3
 Register FAQ Calendar Mark Forums Read

#1
05-01-2012, 06:03 PM
 markweitzman Invited Guest Join Date: Apr 2012 Location: Las Vegas Posts: 69
HW 4 question3

I am confused about question3 - are they not all above 1 and therefore essentially equivalent in the range 2-8. Or did I do the calculation incorrectly?

Mark Weitzman
#2
05-01-2012, 06:18 PM
 Hillbilly Invited Guest Join Date: Mar 2012 Location: West Virginia Posts: 45
Re: HW 4 question3

I agree with the implication of your question -- isn't an epsilon greater than 1 essentially meaningless, making them all equivalent in that sense? Nevertheless, I got distinctly different curves for the four choices, strictly ordered, so I answered on that basis, and apparently that was the right perspective. Devroye gave me weird results on both extremes of N; N=2 particularly bizarre, but I may have a bug in it I haven't found yet.
#3
05-01-2012, 06:32 PM
 markweitzman Invited Guest Join Date: Apr 2012 Location: Las Vegas Posts: 69
Re: HW 4 question3

Well I thought like you did and calculated similar results, when I realized that all equivalent if all greater than 1 seems like the best result.

Mark Weitzman
#4
05-01-2012, 08:45 PM
 silvrous Member Join Date: Apr 2012 Posts: 24
Re: HW 4 question3

I also got values larger than 1 for all of them, and therefore considered them to be equally meaningless for small N...
#5
05-02-2012, 09:16 AM
 mikesakiandcp Member Join Date: Apr 2012 Posts: 31
Re: HW 4 question3

Quote:
 Originally Posted by silvrous I also got values larger than 1 for all of them, and therefore considered them to be equally meaningless for small N...
I also assumed this, since it is a classification problem. Since they are bounds and all greater than one, we cannot infer anything about epsilon for all of them in this range of N, thus they should all be equivalent.
#6
05-03-2012, 07:57 AM
 silvrous Member Join Date: Apr 2012 Posts: 24
Re: HW 4 question3

Could someone from the course staff perhaps weigh in on this? There seem to be two equally valid theories....
#7
05-01-2012, 11:52 PM
 rohanag Invited Guest Join Date: Apr 2012 Posts: 94
Re: HW 4 question3

how are the recursive questions (part c and d) to be plotted?

Last edited by rohanag; 05-01-2012 at 11:52 PM. Reason: clarity
#8
05-02-2012, 01:07 AM
 IamMrBB Invited Guest Join Date: Apr 2012 Posts: 107
Re: HW 4 question3

I have the same question/remark as silvrous and markweitzman. Since epsilon bounds the absolute difference of two probabilities/probability measures/frequencies (at least that is what I understood from the class and a quick google lookup) a statement of epsilon < 3 (for example) is equivalent to the stamement epsilon <= 1. Since all bounds gave numbers in the ball park 3, I reasoned they are all equivalent to bounds epsilon <= 1, i.e. with this small number of examples we cannot say anything about Eout, at least not with a delta of 0.05 per the question.

I have to admit that I thougth long and hard about the what was the intention of the question: just to test if we can calculate these scary looking formulas, or to test our understanding of learning (in particular understanding that you need a minimum amount of data before you can make strong (delta = 5%) statements about the out of sample). Since the calculation aspect was already tested in q2, I hoped and guessed that q3 was aiming at the other aspect.

In the end I therefore went for answer e ("they are all equivalent"), which I thought was the most correct, although there was indeed a chance the question was intended differently.

Professor, or any other expert on the subject, am I correct in my assumption about that epsilon < 3 is equivalent to epsilon <= 1?
#9
05-02-2012, 01:36 AM
 lucifirm Member Join Date: Apr 2012 Posts: 20
Re: HW 4 question3

What I did was to create a vector of the same size of N, but varying from 0 to 1. I don't know if this is the best approach, but it helped me to plot the curves. The problem is I thought I had to chose only one correct answer, so I could not choose c or d, because for me they were both correct for large N.

I don't know if this will work, but here's a link to the figure.

#10
05-02-2012, 04:23 AM
 rohanag Invited Guest Join Date: Apr 2012 Posts: 94
Re: HW 4 question3

thanks lucifirm, do you mean, you tried different values of \epsilon and then compared the left hand side and right hand side of the equations?
you'r right both c and d are the answers for large value of N. But for small values of N, c is the correct answer according to he key.

 Thread Tools Display Modes Hybrid Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 08:54 AM.