LFD Book Forum Noisy Targets as deterministic target function
 User Name Remember Me? Password
 FAQ Calendar Mark Forums Read

 Thread Tools Display Modes
#1
04-12-2016, 08:04 AM
 davidrcoelho Junior Member Join Date: Mar 2016 Posts: 2
Noisy Targets as deterministic target function

Hi everyone,

As I understood, noisy target is when we observe that for a same value of x we get different values of y.

Then, we model this function as a distribution P(y|x) (instead of a deterministic one)

But later on in the book, Yaser says:

"This view suggests that a deterministic target function can be considered a special case of a noisy target, just with zero noise. Indeed, we can formally express any function f as a distribution P(y|x) by choosing P(y|x) to be zero for all y except y = f(x)".

My question is:

How we can consider a value of y is equal to f(x), since the function f is a distribution.
Suppose we have two different values of y for the same input x, what of these two y's is different to f(x)?
#2
04-12-2016, 11:27 PM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,476
Re: Noisy Targets as deterministic target function

Quote:
 Originally Posted by davidrcoelho Hi everyone, As I understood, noisy target is when we observe that for a same value of x we get different values of y. Then, we model this function as a distribution P(y|x) (instead of a deterministic one) But later on in the book, Yaser says: "This view suggests that a deterministic target function can be considered a special case of a noisy target, just with zero noise. Indeed, we can formally express any function f as a distribution P(y|x) by choosing P(y|x) to be zero for all y except y = f(x)". My question is: How we can consider a value of y is equal to f(x), since the function f is a distribution. Suppose we have two different values of y for the same input x, what of these two y's is different to f(x)?
Just to clarify, the statement above from the book is talking about viewing a deterministic target as (a special case of) a noisy target, not the other way around as the title of this thread "Noisy Targets as deterministic target function" may suggest. A noisy target can be viewed as a deterministic target plus noise, but not as a stand-alone deterministic target.

The case you mention, where there are two possible 's for the same is a case of a noisy target, not a deterministic target.
__________________
Where everyone thinks alike, no one thinks very much
#3
04-13-2016, 04:53 AM
 davidrcoelho Junior Member Join Date: Mar 2016 Posts: 2
Re: Noisy Targets as deterministic target function

It is clear now. Thanks a lot!

 Tags chapter 1, noisy target

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 03:45 AM.

 Contact Us - LFD Book - Top