[dsvav]

@MLearning

In my opinion E_out should be near E_in when target is not fixed(i.e averaging over 1000 iterations) .

Unfortunately problem can be anywhere , but most probably in computing error.

Could it be that when you are computing error for E_out for one iteration, the number of sample points for out of sample are 1000 , and if you forgot to change the number of samples points from 100 (from Q 5) to 1000 , then may be that is the cause of difference. (misclassified/sample_size)

I am just guessing , since I make this kind of mistakes often.