Thread: HW 2 Problem 6
View Single Post
Old 07-23-2012, 10:58 AM
rakhlin rakhlin is offline
Join Date: Jun 2012
Posts: 24
Default Re: HW 2 Problem 6

When I generate new data and hypothesis for every single run of 1000 (as the problem suggests) I get stable out-of-sample result close to (slightly greater than) in-sample error.
When I estimate 1000 different out-of-samples for one in-sample and single hypothesis I get very different average error rates with high variability from 0.01 to 0.13 Why so?
Reply With Quote