View Single Post
  #3  
Old 05-11-2012, 06:25 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,477
Default Re: doubt in lecture 11, deterministic noise

Quote:
Originally Posted by rohanag View Post
In the lecture 11, it is mentioned that deterministic noise depends on the hypothesis set, and deterministic noise decreases as the hypothesis set becomes more complex
There are two factors here: the level of deterministic noise, and the complexity of the hypothesis set used to fit the data. Both of these factors are affected by having the target fixed while expanding the hypothesis set. The two effects push overfitting in different directions.

If you want to see the impact of deterministic noise by itself, without having another factor that affects overfitting in play, you should fix the hypothesis set and increase the complexity of the target function.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote