QUESTION: Page 25-26.
and
tradeoff. Shouldn't
always be able to be 0? Since we can always be lucky and just came up with a polynomial with
(number of sample points in
) degree that fits the sample points perfectly. Here since we try to keep
(number of hypothesis) to be 1, we assume we didn't look at the data (thus
) and just straight-forwardly set
(thus avoiding complex
), where
is the
degree perfect-fit polynomial. Wouldn't this case make
always possible to be 0?
Thank you so much!