LFD Book Forum - View Single Post

Sweater Monkey · #8 10-07-2013, 09:09 AM

Quote:

Originally Posted by magdon

You got it mostly right. Your error is assuming both term, the H term and the one without the H give an N to cancel the N in the denominator. One term gives an N and the other gives a (d+1).

Yes I realize that only one term should have the N so the issue must be in how I'm expanding the expression.

I think my problem is how I'm looking at the trace of the $\mathbf{\epsilon}^T\mathbf{\epsilon}$ matrix.

I'm under the impression that $\mathbf{\epsilon}^T\mathbf{\epsilon}$ produces an NxN matrix with a diagonal of all $\sigma^2$ values and 0 elsewhere. I come to this conclusion because the $\epsilon$ are all independent so when multiplied together the covariance of any two should be zero while the covariance of any $\epsilon_i\epsilon_i$ should be the variance of $\sigma^2$ . So then the trace of this matrix should have a sum along the diagonal of $N\sigma^2$ , shouldn't it?