Quote:
Originally Posted by ilya239
Thanks for the explanation.
In HW4 #4 the average hypothesis is measurably shifted from the hypothesis set member giving the lowest mean squared error. Probably because twopoint dataset is too small, i.e. this is not representative of realistic cases?

Indeed, the fewer the number of points, the more likely that the average hypothesis will differ from the best approximation. The difference tends to be small, though.