LFD Book Forum - Variance of Eval

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)

- Chapter 4 - Overfitting (http://book.caltech.edu/bookforum/forumdisplay.php?f=111)

- - Variance of Eval (http://book.caltech.edu/bookforum/showthread.php?t=2377)

Variance of Eval

I'm confused about how to simplify expressions involving Var[Eval(g-)].

I know that Var[Eval(g-)] = E [ ( Eval(g-) - E[Eval(g-)] )^2] = E [ ( Eval(g-) - Eout(g-) )^2] and that for classification P[g-(x) != y] = Eout(g-). I'm not sure how to bring K into any of these expressions.

Any help would be greatly appreciated.

Re: Variance of Eval

Here are two useful facts from probability:

The variance of a sum of independent terms is the sum of the variances:
$Var\left(\sum_{k=1}^K X_k\right)=\sum_{k=1}^KVar(X_k)$

When you scale a random quantity its variance scales quadratically:

[Hint: so, if you scale something by $\frac{1}{K}$ its variance scales by $\frac{1}{K^2}$ ; the validation error is the average of K independent things (What things? Why are they independent?)]

Quote:

Originally Posted by axelrv (Post 6659)