Quote:
Originally Posted by yaser
This is discussed here:
http://book.caltech.edu/bookforum/sh...0360#post10360
The main point is that once you consider the sample, the probability becomes conditional on how this sample came out, and that could violate the bound, whereas the probability before a sample was drawn always obeys the bound.

Is the Cmin coin of Q2 (HW2) not analogous to pocket PLA's finalhypothesis
g ? In pocket PLA, we always choose the hypothesis which gave mindisagreement across experiments(~ bins). The probability of badevent in pocket case is still bound by hoeffdings inequality, right ?
The possible difference I can see is that in Cmin case, sample kept changing, while in pocket case sample does not change, only color of marbles insidebin and outside bin changes, as the hypothesis changes. Is that the key point?