LFD Book Forum - Out of sample error for linear noisy target

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)

- Chapter 3 - The Linear Model (http://book.caltech.edu/bookforum/forumdisplay.php?f=110)

- - Out of sample error for linear noisy target (http://book.caltech.edu/bookforum/showthread.php?t=4486)

Out of sample error for linear noisy target

I am confused about how to derive the Eout=(1+(d+1)/N)\sigma^2 for the learning curve of linear target error, as shown as the third equation in http://work.caltech.edu/library/084.pdf ?

Could anybody help me?

Thanks!

Re: Out of sample error for linear noisy target

Quote:

Originally Posted by rabbitdoll (Post 11688)

The derivation (sketched in Exercise 3.4 in the book) makes idealized assumptions to make it possible to get this result exactly and not asymptotically. The key assumption is that the test set inputs are the same as the training set inputs. This obviously wouldn't make sense under normal circumstances, except that in this case the "novelty" in the test set is that the noise realization is different from that of the training set. If you accept that, then the derivation would be fairly straightforward by going through the steps in the exercise.