LFD Book Forum Problem 1.12a
 Register FAQ Calendar Mark Forums Read

#1
09-17-2013, 06:03 PM
 Sandes Junior Member Join Date: Sep 2013 Posts: 2
Problem 1.12a

I'm somewhat lost in my attempt to show 1.12 a I can see intuitively that the mean will be the best h value since then Ein is the standard deviation, but I'm not sure where to go from there. I've already finished B and C, A is the only part I'm having trouble with.

Perhaps I'm going in the wrong direction but one of the things I realized is that the constraint could be restated as minimizing h^2 -2 h yn summed over all N but that could be going off in completely the wrong direction.

Adding some value a to the mean produces (mean-yn)^2 + a^2 +2 a(mean-yn) That's another possible approach but I'm not really sure where I would take that approach either.
#2
09-17-2013, 09:09 PM
 Sweater Monkey Junior Member Join Date: Sep 2013 Posts: 6
Re: Problem 1.12a

Quote:
 Originally Posted by Sandes Perhaps I'm going in the wrong direction but one of the things I realized is that the constraint could be restated as minimizing h^2 -2 h yn summed over all N but that could be going off in completely the wrong direction.
This is what I did and it led to the correct answer of hmean

To start off work on factoring out h, then it should become more obvious how to manipulate the function to find its minimum value. Good luck!
#3
09-18-2013, 07:35 PM
 meixingdg Junior Member Join Date: Sep 2013 Posts: 4
Re: Problem 1.12a

I tried to take the derivative of the function to find the minimum, but I'm still not sure how the minimum corresponds to h being the in-sample mean.
Also, what exactly is hmean? It seems to be a scalar value, a number of some sort, but I thought that h is a hypothesis/function?
#4
09-19-2013, 03:55 AM
 magdon RPI Join Date: Aug 2009 Location: Troy, NY, USA. Posts: 597
Re: Problem 1.12a

Quote:
 Originally Posted by Sandes I Perhaps I'm going in the wrong direction but one of the things I realized is that the constraint could be restated as minimizing h^2 -2 h yn summed over all N but that could be going off in completely the wrong direction.
This is the right idea. Your hypothesis h is just a number in this case. Ein is a function of this number (variable) h. One way to minimize a function of a variable h is to take the derivative and set it to zero.
__________________
Have faith in probability

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 12:34 AM.