LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   The Final (http://book.caltech.edu/bookforum/forumdisplay.php?f=138)
-   -   Q16 and Q17 clarification (http://book.caltech.edu/bookforum/showthread.php?t=4346)

 Elroch 06-11-2013 07:21 AM

Q16 and Q17 clarification

In these two questions there are the independent possibilities of rising falling or staying the same and the same for . In the latter case, while for the two inequalities the meaning is clear and based (with high confidence) on an adequate test sample, what the precise meaning would be for equality is not clear.

In any case, the options are not complete (there are 5 of 9), so presumably what is wanted is the greatest from those offered, regardless of whether it is actually the most frequent possibility?

In any case, could you clarify the precise meaning of the fifth option?

 jforbes 06-11-2013 11:34 AM

Re: Q17 and Q18 clarification

Quote:
 Originally Posted by Elroch (Post 11111) In these two questions there are the independent possibilities of rising falling or staying the same and the same for . In the latter case, while for the two inequalities the meaning is clear and based (with high confidence) on an adequate test sample, what the precise meaning would be for equality is not clear. In any case, the options are not complete (there are 5 of 9), so presumably what is wanted is the greatest from those offered, regardless of whether it is actually the most frequent possibility? In any case, could you clarify the precise meaning of the fifth option?
I used the same test set to evaluate the out of sample error for the alternatives, so it was in principle quite possible to get the same . I'm not sure if this was the appropriate approach.

In principle though, what you're doing with your test set is you're approximating the true value of , which you only approach in the limit of an infinite test set, in which case the probability that you get exactly the same should be vanishingly small unless your hypotheses were the same exact function, which won't happen in our situation.

 Elroch 06-11-2013 11:59 AM

Re: Q17 and Q18 clarification

Quote:
 Originally Posted by jforbes (Post 11117) I used the same test set to evaluate the out of sample error for the alternatives, so it was in principle quite possible to get the same . I'm not sure if this was the appropriate approach. In principle though, what you're doing with your test set is you're approximating the true value of , which you only approach in the limit of an infinite test set, in which case the probability that you get exactly the same should be vanishingly small unless your hypotheses were the same exact function, which won't happen in our situation.
I realise that, and was using a large test set, so the situation did not arise. What I did have on one question was a lot of unchanged and different . As I result, I was uncomfortable with my answer (although it was correct).

 jforbes 06-11-2013 01:39 PM

Re: Q17 and Q18 clarification

Quote:
 Originally Posted by Elroch (Post 11118) I realise that, and was using a large test set, so the situation did not arise. What I did have on one question was a lot of unchanged and different . As I result, I was uncomfortable with my answer (although it was correct).
Ah, good point. I didn't check all 9 conditions, just the 5 given. There was a clear winner every time, even with a not-ridiculously-large test set, so I didn't bother checking that scenario, which in retrospect seems like it could indeed arise frequently.

 RJT_12 12-06-2021 06:13 AM

Re: Q16 and Q17 clarification

In one of the questions as you mentioned E_in remains the same for more than 50% of cases. If you compare remaining cases where E_in "strictly goes up or down" excluding equals, than you can arrive at correct answer. However, "Up or down means strictly so" could mean number of cases when E_in goes strictly up i.e. remaining set being same or lower. In such case the answer looks incorrect. Some clarification could be helpful.

 All times are GMT -7. The time now is 07:53 AM.