Quote:
Originally Posted by melipone
Is ensemble learning with voting, an intersection or union of VC dimensions?
|
Ensemble learning (covered briefly in Lecture 18) reuses the same hypothesis set by combining the hypotheses in it, so in general it is neither an intersection nor a union. Since the combination can involve only one hypothesis (replicating the original hypothesis set) or multiple hypotheses (resulting possibly in new hypotheses), the VC dimension of the resulting hypothesis set is bigger (at least not smaller) than the original VC dimension.