View Single Post
Old 02-03-2013, 10:45 AM
yaser's Avatar
yaser yaser is offline
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,478
Default Re: General question on VC bounds in Q9-10

Originally Posted by melipone View Post
Is ensemble learning with voting, an intersection or union of VC dimensions?
Ensemble learning (covered briefly in Lecture 18) reuses the same hypothesis set by combining the hypotheses in it, so in general it is neither an intersection nor a union. Since the combination can involve only one hypothesis (replicating the original hypothesis set) or multiple hypotheses (resulting possibly in new hypotheses), the VC dimension of the resulting hypothesis set is bigger (at least not smaller) than the original VC dimension.
Where everyone thinks alike, no one thinks very much
Reply With Quote