Exercise 3.4

Re: Exercise 3.4
You can consider doublechecking your answer of 3.4(b). Hope this helps.

Re: Exercise 3.4
I am not sure how to approach part (a). Are we supposed to explain why that insample estimate intuitively makes sense, or (algebraically) manipulate expressions given earlier into it?

Re: Exercise 3.4

Re: Exercise 3.4
1. I got $y^{\prime}=y\epsilon+\epsilon^{\prime}$.
and $\hat{y}y^{\prime}=H\epsilon +\epsilon^{\prime}$. 
Re: Exercise 3.4
You got it mostly right. Your error is assuming both term, the H term and the one without the H give an N to cancel the N in the denominator. One term gives an N and the other gives a (d+1).
Quote:

Re: Exercise 3.4
Quote:
I think my problem is how I'm looking at the trace of the matrix. I'm under the impression that produces an NxN matrix with a diagonal of all values and 0 elsewhere. I come to this conclusion because the are all independent so when multiplied together the covariance of any two should be zero while the covariance of any should be the variance of . So then the trace of this matrix should have a sum along the diagonal of , shouldn't it? :clueless: 
Re: Exercise 3.4
I'm having a bit of difficulty with 3.4b. I take \hat(y)  y and multiply by (XX^T)^{1}XX^T, which ends up reducing the expression to just H\epsilon. However, then I can't use 3.3c in simplifying 3.3c, which makes me think I did something wrong. Can somebody give me a pointer?
Also, it'd be great if there was instructions somewhere about how to post in math mode. Perhaps I just missed them? 
Re: Exercise 3.4
Yes, that is right. You have to be more careful but use similar reasoning with
Quote:

Re: Exercise 3.4
is not , but that is close. Recall
Quote:

Re: Exercise 3.4

Re: Exercise 3.4

Re: Exercise 3.4

Re: Exercise 3.4
For part (c), would the result of (yhat  y) (from part b) be Ein(wlin) in terms of epsilon, since (yhat  y) is the insample error?

Re: Exercise 3.4
y and yhat are vectors. The normsquared of (yhat  y) divided by N is the insample error.
Quote:

Re: Exercise 3.4

Re: Exercise 3.4

All times are GMT 7. The time now is 11:54 PM. 
Powered by vBulletin® Version 3.8.3
Copyright ©2000  2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. AbuMostafa, Malik MagdonIsmail, and HsuanTien Lin, and participants in the Learning From Data MOOC by Yaser S. AbuMostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.