LFD Book Forum E_in E_out trade-off, Couldn't E_in always be 0?
 Register FAQ Calendar Mark Forums Read

#1
08-14-2014, 09:30 PM
 chemaoxfz Junior Member Join Date: Aug 2014 Posts: 1
E_in E_out trade-off, Couldn't E_in always be 0?

QUESTION: Page 25-26. and tradeoff. Shouldn't always be able to be 0? Since we can always be lucky and just came up with a polynomial with (number of sample points in ) degree that fits the sample points perfectly. Here since we try to keep (number of hypothesis) to be 1, we assume we didn't look at the data (thus ) and just straight-forwardly set (thus avoiding complex ), where is the degree perfect-fit polynomial. Wouldn't this case make always possible to be 0?

Thank you so much!
#2
08-15-2014, 06:59 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: E_in E_out trade-off, Couldn't E_in always be 0?

Quote:
 Originally Posted by chemaoxfz QUESTION: Page 25-26. and tradeoff. Shouldn't always be able to be 0? Since we can always be lucky and just came up with a polynomial with (number of sample points in ) degree that fits the sample points perfectly. Here since we try to keep (number of hypothesis) to be 1, we assume we didn't look at the data (thus ) and just straight-forwardly set (thus avoiding complex ), where is the degree perfect-fit polynomial. Wouldn't this case make always possible to be 0? Thank you so much!
The statement "can always be zero" needs to be clarified a bit. If you mean "it is possible that the error will be zero using a singleton hypothesis set," then that's true. If you mean "we can always choose a singleton hypothesis set that makes the error zero" then that's not true, because we don't know which hypothesis to pick if we didn't look at the data.

Being lucky is similar to being lucky with the lottery; you can always pick the winning lottery ticket if you are lucky enough, but that does not mean that there is a way to make this happen.
__________________
Where everyone thinks alike, no one thinks very much

 Tags e_in

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 05:35 PM.