View Single Post
Old 02-11-2013, 11:45 AM
ilya239 ilya239 is offline
Senior Member
Join Date: Jul 2012
Posts: 58
Default Re: lecture 8: understanding bias

Originally Posted by gah44 View Post
Well, it is also that the two point data set is small relative to the two parameter hypotheses. If you have 100 points, and 99th degree polynomials, it would also have large variance. I will guess that minimizing bias plus variance happens with the number of fit parameters near the square root of the number of points per data set.
Large variance, sure. I was trying to understand why large bias. If you take a huge number of 100-point datasets, learn a hypothesis from each, and take the average value of these, why might it be far from the target function's value?
On the other hand, I'm not sure how to prove that it won't be far
Reply With Quote