LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 2 - Training versus Testing

Thread Tools Display Modes
Prev Previous Post   Next Post Next
Old 04-19-2012, 01:18 PM
goodnight goodnight is offline
Junior Member
Join Date: Apr 2012
Posts: 2
Default Hoeffding's inequality

Hi All,

I'm not sure that I'm understand the Hoeffding's inequality.

I'm quite confused to be honest.
Could you please check that my examples are correct or not?

1) There is a gallup-poll company and this company measures that the citizens wants to participate on the elections or not.

They want to ask 2000 persons, and they choose an epsilon = 0.03.
Can I use Hoeffding's inequality for this issue at all?
2*exp(-2*0.03*0.03*2000) = 0.0546. Does it mean that they have 5% chance that their poll will close to the reality with an error of 3%?

If it's true, I'm very confused. Because it's also true in the US and in Monaco. In Monaco they asked every 2nd person, but in the USA they asked only very few persent of the population!

2) If we stay with the example of the bins:
It doesn't matter how many balls are there in the bin. It gives us an upper bound of the ratio of the red and green balls regarding the sample.
The thing which confuse me that the bin can have 100 balls or a million, sampling 10 balls we have the same upper bound to estimate the real distribution of the balls! I guess I don't understand something because it seems impossible.
Reply With Quote

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT -7. The time now is 01:56 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.