LFD Book Forum bias -variance graph

#1
04-24-2013, 06:31 PM
 Katie C. Member Join Date: Apr 2013 Posts: 17
bias -variance graph

How is the gray zone of the bias-variance plot (slide 15/22 in Lecture 8) drawn? I am trying to understand how to compute bias(x) and var(x). Are these quantities illustrated in the graphs?
#2
04-24-2013, 07:00 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,477
Re: bias -variance graph

Quote:
 Originally Posted by Katie C. How is the gray zone of the bias-variance plot (slide 15/22 in Lecture 8) drawn? I am trying to understand how to compute bias(x) and var(x). Are these quantities illustrated in the graphs?
The grey zones' height is the square root of the (square root to match the scale of other elements in the graph). To calculate , evaluate the formula in slide 8 of that lecture. You can do that analytically by evaluating the expected value, or you can do that using Monte Carlo method; generating data sets at random, evaluating the part inside the expectation for each , then averaging these quantities over a large number of 's.
__________________
Where everyone thinks alike, no one thinks very much
#3
04-25-2013, 07:36 PM
 Katie C. Member Join Date: Apr 2013 Posts: 17
Re: bias -variance graph

As I understand it, the is a function that was learned from a training data set and is now being evaluated on a new set of x values, is that correct? In fact, I think that all the red xs on slide 8 are from new data that was not used during training. Is that correct?
#4
04-25-2013, 07:39 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,477
Re: bias -variance graph

Quote:
 Originally Posted by Katie C. As I understand it, the is a function that was learned from a training data set and is now being evaluated on a new set of x values, is that correct? In fact, I think that all the red xs on slide 8 are from new data that was not used during training. Is that correct?
You are correct on both counts. If you pick the test point at random, it's statistically certain that it will be different from the two points you used for training.
__________________
Where everyone thinks alike, no one thinks very much

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 12:06 PM.