LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 1 - The Learning Problem

Thread Tools Display Modes
Old 03-08-2016, 11:55 PM
pouramini pouramini is offline
Join Date: Mar 2016
Posts: 16
Default Re: Hoeffding Inequality

Yes, we don't select h, h is an element of H and we select g

We can't restrict h, then I think emphasizing that h must be fixed before ... is a bit misleading
Reply With Quote
Old 05-21-2016, 01:50 AM
henry2015 henry2015 is offline
Join Date: Aug 2015
Posts: 31
Default Re: Hoeffding Inequality

Originally Posted by pouramini View Post
Second question:

In "h is fixed before you generate the data set"
I also can't understand your emphasis on "before".

Do you want to say that h shouldn't change?
because I feel h is independent from D then "before" or "after" doesn't mean much. We don't need to have an h in mind to be able to generate D, we can select D, then decide which h to use, then evaluate h over D, but we should use the same h for the test set, right? or maybe h is used somehow in generating D?! Anyway, I think you may mean it should be selected independently from D
I have a similar thought as yours -- the set H is defined/generated independently from D. Hence, defining H before or after choosing D doesn't matter.

However, I think all h in H should be used against D (which is chosen independently from H), and then the learning algorithm will pick one of the h's in H to be g based on the results.

Anyway, I am also just learning this topic; I think we should wait for the "official" comment
Reply With Quote

fixed hypothesis, hoeffding inequality

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT -7. The time now is 09:12 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.