View Single Post
Old 08-11-2013, 07:02 PM
yaser's Avatar
yaser yaser is offline
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,478
Default Re: The VC Proof

Originally Posted by Averroes View Post
I succeeded to understand most of it except (A.4) in the bottom of page 189. I can understand that you have applied Hoeffding Inequality to h*, but your explanation on how this applies to h* conditioned to the sup_H event, is hard to grasp for me.
Thank you for your post. The hypothesis h^* is based on a fixed data set among the possible {\cal D}s. Once we know that such {\cal D} exists, the conditioned-upon statement does not matter. We have a fixed hypothesis h^* and independently generated data sets {\cal D}', so we can apply Hoeffding to that in isolation.
Where everyone thinks alike, no one thinks very much
Reply With Quote