LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Homework 6 (http://book.caltech.edu/bookforum/forumdisplay.php?f=135)
-   -   doubt in lecture 11, deterministic noise (http://book.caltech.edu/bookforum/showthread.php?t=479)

menon.rx 08-21-2012 09:11 AM

Deterministic noise and HW6-Q1
 
I agree. However, the amount of noise depends upon N and the relative complexity of the target function. Therefore, isn't it true that one cannot make a general statement about trend without knowledge of the relative complexity between the hypothesis and the target function as well as N.

Andrs 08-21-2012 09:33 AM

Re: Deterministic noise and HW6-Q1
 
Quote:

Originally Posted by menon.rx (Post 4212)
I agree. However, the amount of noise depends upon N and the relative complexity of the target function. Therefore, isn't it true that one cannot make a general statement about trend without knowledge of the relative complexity between the hypothesis and the target function as well as N.

If you have the hypothesis set and and the target function defined (fixed), the deterministic noise should also be defined ("fixed") and independent of the amount of training data (N). The overfitting and Eout are dependent of N.

menon.rx 08-21-2012 11:39 AM

Re: doubt in lecture 11, deterministic noise
 
The bias of the deterministic noise is independent of N. However, doesn't the variance of noise still depend upon N?


All times are GMT -7. The time now is 11:51 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.