Re: Q10 higher bound
Quote:

Re: Q10 higher bound
Quote:
for N=1, H={+,} and shatters this 1 point for N=2, H={+,+} and does not shatter these two points. for N=3, H={++, ++, ++, +, +, +} and does shatter two points. What is the VC dimension of this hypothesis set? From the N=2 case, I might conclude that it's 1 (it fails to shatter two points), but from the N=3 case I might conclude it's 2 (it shatters 2 of the points within this set of points). Where am I going wrong? 
Re: Q10 higher bound
Since the homework set was now due, I was wondering if the course staff could weigh in on this question. Did our discussion adequately cover this question or were there any nuances that we missed?

Re: Q10 higher bound
Quote:

Re: Q10 higher bound
Quote:

Re: Q10 higher bound
There is a proviso to my glib claim above that absolutely any subset can be a hypothesis. While this is true when the underlying set is finite or countable, when it is uncountably infinite I believe it only makes sense to have hypotheses which are measurable sets, according to the probability distribution associated with samples.
[Almost anything that makes any sense is likely to satisfy this, but it is not difficult to construct pathological examples even when the sample space is as simple as the unit interval with the uniform distribution]. 
Re: Q10 higher bound
Quote:

Re: Q10 higher bound

All times are GMT 7. The time now is 07:42 AM. 
Powered by vBulletin® Version 3.8.3
Copyright ©2000  2020, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. AbuMostafa, Malik MagdonIsmail, and HsuanTien Lin, and participants in the Learning From Data MOOC by Yaser S. AbuMostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.