LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 1 - The Learning Problem (http://book.caltech.edu/bookforum/forumdisplay.php?f=108)
-   -   Clarification needed for Hoeffding Inequality (http://book.caltech.edu/bookforum/showthread.php?t=4276)

aland 05-07-2013 03:55 PM
Clarification needed for Hoeffding Inequality
 
It's remarkable to have the chance to ask the author a question about his book. Normally, and often, I go through life with questions like these unanswered. So I appreciate greatly a resource like this.

So, the LHS side of the Hoeffding inequality is a probability. And yet, the RHS, as best as I can tell, has a range from 0 to 2.

What am I missing?

yaser 05-07-2013 04:41 PM
Re: Clarification needed for Hoeffding Inequality
 
Quote:
Originally Posted by aland (Post 10754)
It's remarkable to have the chance to ask the author a question about his book. Normally, and often, I go through life with questions like these unanswered. So I appreciate greatly a resource like this.

So, the LHS side of the Hoeffding inequality is a probability. And yet, the RHS, as best as I can tell, has a range from 0 to 2.

What am I missing?
You are correct. The RHS is an upper bound on the probability. Sometimes it's a meaningful bound and sometimes it's a trivial bound, but it is always a valid bound.


All times are GMT -7. The time now is 04:02 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.