LFD Book Forum Exercise 2.6
 User Name Remember Me? Password
 Register FAQ Calendar Mark Forums Read

 Thread Tools Display Modes
#1
09-21-2016, 02:41 PM
 wolszhang Junior Member Join Date: Sep 2016 Posts: 5
Exercise 2.6

I am pretty confused with the Ein and Eout. According to my understanding, Etest 's error bar is calculated by Hoeffding Bounds with hypothesis set size = 1. But if i want to use Ein to estimate Eout, I either need the growth function or dvc and none of these two is given. i would assume that Etest would have a smaller error bar. But i cannot prove it.
Also, for part(b), the only reason i come up with is that the hypothesis that we would be testing would not be as good as it is with a bigger N. And if Etest is big, we are screwed.
Any help would be appreciated. Thanks
#2
10-19-2016, 07:07 AM
 wqymcgill Junior Member Join Date: Oct 2016 Posts: 1
Re: Exercise 2.6

Hi,

For part(a), I simply assume dvc=0 and get an error bar of about 0.316. Etest's error bar is only about 0.096. So Ein will always be higher thatn Etest no matter what dvc is.

For part(b), I don't know why either.. Hope anyone helps.
#3
07-08-2017, 11:04 PM
 bonfire09 Junior Member Join Date: Jul 2017 Posts: 1
Re: Exercise 2.6

I'm stuck on this problem too. I was thinking we just use the generalization error for both.

Do we just calculate E_out<=E_test+sqrt(1/200 ln (2/0.5)) and
E_out<=E_in+sqrt(1/400 ln(2/0.5)) ?
#4
09-23-2017, 11:06 AM
 SpencerNorris Junior Member Join Date: Sep 2017 Posts: 2
Re: Exercise 2.6

I'm wondering what bounds we should use for E_test and E_in. It states that E_test obeys the simple Hoeffding bound; does this mean that we should use the generalization error outlined on p.40, eq. 2.1? Or can we use the VC Bound on E_test as well as E_in?
#5
09-23-2017, 06:15 PM
 anirban.das Junior Member Join Date: Aug 2016 Posts: 1
Re: Exercise 2.6

2.6.a I think that the training error bound (as well as the testing error bound) is given by equation (2.1), because in this particular case the hypothesis set is finite already.

2.6.b Also, here I suppose more examples in testing data set will do nothing much as it is already a good apprx. to the E_out, but this will decrease the available training samples and we would get a stupid final hypothesis.

Any thoughts?
#6
02-22-2018, 05:09 AM
 k_sze Member Join Date: Dec 2016 Posts: 12
Re: Exercise 2.6

I don't think the growth function or VC dimension are involved at all? The exercise tells us the exact size of the hypothesis set (the learning model), which is 1000, right?
#7
03-15-2018, 02:10 AM
 seoma Junior Member Join Date: Mar 2018 Posts: 1
Re: Exercise 2.6

thanks for your post
کاراپ
__________________
[URL="https://carap.ir/"]کاراپ[/URL]

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 02:17 AM.

 Contact Us - LFD Book - Top