Thread: role of P(X) ?
View Single Post
Old 04-11-2013, 02:48 AM
yaser's Avatar
yaser yaser is offline
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,478
Default Re: role of P(X) ?

Originally Posted by kokrah View Post
The Hoeffding bound for the model H in chapter one, only requires that
we make the assumption that the input examples are a random sample
from the bin; so we can generalize the sample error.

What role does the distribution on X play? It appears to me that we don't need
it. (at least the way the issue of feasibility is setup in chapter 1)
ie. true mismatch ~ sample mismatch.

We need the existence of the input probability distribution P so that "a random sample" becomes well defined, but we don't need any particular P to do that since any P will correspond to a legitimate \mu for the bin.
Where everyone thinks alike, no one thinks very much
Reply With Quote