@MLearning
When I compute the difference between E_in and E_out I get the difference to be around 0.01.
I still think difference should not be significant , does not this comes from Hoeffding Inequality ?
Also since we are suppressing the "very bad event happening" and "very good event happening" by taking average over 1000 runs , so E_out should track E_in.
This is my understanding , there is good chance that I am wrong
By the way what is the difference you are getting ?