Thread: Hw5 Q8 E_out
View Single Post
Old 05-05-2013, 10:07 PM
yaser's Avatar
yaser yaser is offline
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: Hw5 Q8 E_out

Originally Posted by marek View Post
I am struggling to understand how to calculate E_{out} in this question. I have two competing theories, which I will describe below. Any help is greatly appreciated.

Once the algorithm terminates, I have w^{(t)}. I now generate a new set of data points \{X_i\}_{i=1}^M. Using my original target function to generate the corresponding Y_i = f(X_i).

Case 1. Just use the same cross entropy error calculation but on this new data set.

E_{out} = \frac{1}{M} \sum_{i=1}^M \ln (1+e^{-Y_i w^\top X_i})
The above approach is correct. The problem specifies the cross entropy error measure, so E_{\rm out} = {\rm E} [ \ln (1+e^{-y{\bf w}^\top {\bf x}})], where the expectation is w.r.t. both {\bf x},y. The above formula estimates that through a random sample.
Where everyone thinks alike, no one thinks very much
Reply With Quote