LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 3 - The Linear Model (http://book.caltech.edu/bookforum/forumdisplay.php?f=110)

 magdon 10-07-2013 09:27 AM

Re: Exercise 3.4

is not , but that is close. Recall

Quote:
 Originally Posted by aaoam (Post 11546) I'm having a bit of difficulty with 3.4b. I take \hat(y) - y and multiply by (XX^T)^{-1}XX^T, which ends up reducing the expression to just H\epsilon. However, then I can't use 3.3c in simplifying 3.3c, which makes me think I did something wrong. Can somebody give me a pointer? Also, it'd be great if there was instructions somewhere about how to post in math mode. Perhaps I just missed them?

 Sweater Monkey 10-07-2013 07:48 PM

Re: Exercise 3.4

Quote:
 Originally Posted by magdon (Post 11547) Yes, that is right. You have to be more careful but use similar reasoning with
Ahhhh, yes I see now why doesn't have a factor of N! The trace of this matrix is just .

Thanks Professor :)

 smiling_assassin 10-07-2013 10:54 PM

Re: Exercise 3.4

Quote:
 Originally Posted by Sweater Monkey (Post 11551) Ahhhh, yes I see now why doesn't have a factor of N! The trace of this matrix is just . Thanks Professor :)

But isn't a matrix? So trace would be instead of ? I know is . What am I missing?

 magdon 10-08-2013 07:39 AM

Re: Exercise 3.4

You are right, is an matrix. But its trace is not . You may consider looking through Exercise 3.3, and in particular, part (d) should be helpful.

Quote:
 Originally Posted by smiling_assassin (Post 11553) But isn't a matrix? So trace would be instead of ? I know is . What am I missing?

 meixingdg 10-09-2013 02:05 PM

Re: Exercise 3.4

For part (c), would the result of (y-hat - y) (from part b) be Ein(wlin) in terms of epsilon, since (y-hat - y) is the in-sample error?

 magdon 10-10-2013 09:11 AM

Re: Exercise 3.4

y and y-hat are vectors. The norm-squared of (y-hat - y) divided by N is the in-sample error.

Quote:
 Originally Posted by meixingdg (Post 11559) For part (c), would the result of (y-hat - y) (from part b) be Ein(wlin) in terms of epsilon, since (y-hat - y) is the in-sample error?

 jamesclyeh 11-10-2013 04:27 PM

Re: Exercise 3.4

Hi,

For part (a), in one of the last steps I did:

Rearrange:
Since ,

Are these steps correct?
I found subbing back in a bit recursive because I previously solved for and plugged that in to get .

Also for (b)
Is the answer <---I ll delete this once its confirmed.

Thanks,
James

 yaser 11-17-2013 03:22 AM

Re: Exercise 3.4

Hi James,

I am slow in responding this term as I am attending to the edX forum, but here are my quick comments:

For part (a), why is (what happened to the added noise)?

For part (b), your formula is correct.

All times are GMT -7. The time now is 12:17 PM.