LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 1 - The Learning Problem (http://book.caltech.edu/bookforum/forumdisplay.php?f=108)
-   -   Noisy Targets as deterministic target function (http://book.caltech.edu/bookforum/showthread.php?t=4665)

 davidrcoelho 04-12-2016 09:04 AM

Noisy Targets as deterministic target function

Hi everyone,

As I understood, noisy target is when we observe that for a same value of x we get different values of y.

Then, we model this function as a distribution P(y|x) (instead of a deterministic one)

But later on in the book, Yaser says:

"This view suggests that a deterministic target function can be considered a special case of a noisy target, just with zero noise. Indeed, we can formally express any function f as a distribution P(y|x) by choosing P(y|x) to be zero for all y except y = f(x)".

My question is:

How we can consider a value of y is equal to f(x), since the function f is a distribution.
Suppose we have two different values of y for the same input x, what of these two y's is different to f(x)?

 yaser 04-13-2016 12:27 AM

Re: Noisy Targets as deterministic target function

Quote:
 Originally Posted by davidrcoelho (Post 12316) Hi everyone, As I understood, noisy target is when we observe that for a same value of x we get different values of y. Then, we model this function as a distribution P(y|x) (instead of a deterministic one) But later on in the book, Yaser says: "This view suggests that a deterministic target function can be considered a special case of a noisy target, just with zero noise. Indeed, we can formally express any function f as a distribution P(y|x) by choosing P(y|x) to be zero for all y except y = f(x)". My question is: How we can consider a value of y is equal to f(x), since the function f is a distribution. Suppose we have two different values of y for the same input x, what of these two y's is different to f(x)?
Just to clarify, the statement above from the book is talking about viewing a deterministic target as (a special case of) a noisy target, not the other way around as the title of this thread "Noisy Targets as deterministic target function" may suggest. A noisy target can be viewed as a deterministic target plus noise, but not as a stand-alone deterministic target.

The case you mention, where there are two possible 's for the same is a case of a noisy target, not a deterministic target.

 davidrcoelho 04-13-2016 05:53 AM

Re: Noisy Targets as deterministic target function

It is clear now. Thanks a lot!

 All times are GMT -7. The time now is 06:11 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.