Thread: Page 63 and excercise 2.8 View Single Post
#3
10-02-2014, 09:17 PM
 magdon RPI Join Date: Aug 2009 Location: Troy, NY, USA. Posts: 597
Re: Page 63 and excercise 2.8

because is defined as an expectation with respect to data sets of g(x). The average over data sets approximates this expectation.

Yes, is not a valid hypothesis: it may not be in your hypothesis set; it may not even be binary. It is never used as a classifier. It is just used to represent "what would happen on average after learning", and this abstract function plays a role in defining the bias in the bias variance decomposition.

Quote:
 Originally Posted by Newbrict I think because it's computed over a finite set of points, whereas the actual value for is an exact solution
__________________
Have faith in probability