Re: Q5 Least Squares Behaviour
So... haha... systematic error.
Just as another student (sandeep) was, I was getting an average E_in on 1000 trials of 100 of ~ 0.13
I believe this is indicative not accounting for the case where the slope of the linear regression solution g is opposite sign of that of the target function f.
In a naive approach to classification... you will get 100% error in that case. The case seems to occur predictably enough to bias the correct answer you might get to ~0.13.
Oddly enough... I am very satisfied with that... at least it confirms laws of large numbers.
Everything does though...
