Quote:
Originally Posted by MLearning
@JohnH,
I see your point and your argument makes sense. However, what if those remaining volcabularies in H' are complex enough to completely characterize the target function. Remember the target function is fixed in this case.
|
Deterministic noise will either be reduced or stay the same. So the change is zero with some probability and negative with some probability, so the expected change is negative. (What a hand-waving argument
)