LFD Book Forum
Page 2 of 2 1 2
Show 40 post(s) from this thread on one page

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 1 - The Learning Problem (http://book.caltech.edu/bookforum/forumdisplay.php?f=108)
-   -   Hoeffding Inequality (http://book.caltech.edu/bookforum/showthread.php?t=4617)

pouramini 03-08-2016 11:55 PM
Re: Hoeffding Inequality
 
Yes, we don't select h, h is an element of H and we select g

We can't restrict h, then I think emphasizing that h must be fixed before ... is a bit misleading

henry2015 05-21-2016 01:50 AM
Re: Hoeffding Inequality
 
Quote:
Originally Posted by pouramini (Post 12287)
Second question:

In "h is fixed before you generate the data set"
I also can't understand your emphasis on "before".

Do you want to say that h shouldn't change?
because I feel h is independent from D then "before" or "after" doesn't mean much. We don't need to have an h in mind to be able to generate D, we can select D, then decide which h to use, then evaluate h over D, but we should use the same h for the test set, right? or maybe h is used somehow in generating D?! Anyway, I think you may mean it should be selected independently from D
I have a similar thought as yours -- the set H is defined/generated independently from D. Hence, defining H before or after choosing D doesn't matter.

However, I think all h in H should be used against D (which is chosen independently from H), and then the learning algorithm will pick one of the h's in H to be g based on the results.

Anyway, I am also just learning this topic; I think we should wait for the "official" comment :)


All times are GMT -7. The time now is 05:42 PM.
Page 2 of 2 1 2
Show 40 post(s) from this thread on one page

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.