LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 1 - The Learning Problem

Reply
 
Thread Tools Display Modes
  #1  
Old 09-11-2013, 10:31 AM
goldsj3 goldsj3 is offline
Junior Member
 
Join Date: Sep 2013
Posts: 1
Default Chapter 1 - Exercise 1.9

Based on the marbles example, I understand that u is the probability of choosing a red marble from the bin of marbles and v is the fraction of red marbles in the sample of chosen marbles. And I think that the LHS of the Hoeffding Inequality represents the probability of v deviating from u being greater than the error bar epsilon. Now, I am not sure how I should choose an epsilon to evaluate this probability and where I should begin. Can someone point me in the right direction?
Reply With Quote
  #2  
Old 09-11-2013, 12:31 PM
magdon's Avatar
magdon magdon is offline
RPI
 
Join Date: Aug 2009
Location: Troy, NY, USA.
Posts: 595
Default Re: Chapter 1 - Exercise 1.9

If \mu=0.9 and \nu\le0.1, it implies that |\nu-\mu|>0.8^- (any number slightly less than 0.8). By the implication bound,

P[\nu\le0.1] \le P[|\nu-\mu|>0.8^-]

By looking at the RHS, one can identify \epsilon for applying the Hoeffding bound.
__________________
Have faith in probability
Reply With Quote
  #3  
Old 09-15-2015, 02:51 PM
eshmrt eshmrt is offline
Junior Member
 
Join Date: Sep 2015
Posts: 2
Default Re: Chapter 1 - Exercise 1.9

Since we're only looking at epsilon applied in one direction, meaning that we're only interested in nu being mu - 0.8 and not mu + 0.8, should we drop the leading 2 from the bound calculation? I'm not sure if I'm interpreting this bound correctly or simply overthinking things.
Reply With Quote
  #4  
Old 09-21-2015, 04:27 PM
magdon's Avatar
magdon magdon is offline
RPI
 
Join Date: Aug 2009
Location: Troy, NY, USA.
Posts: 595
Default Re: Chapter 1 - Exercise 1.9

You are right. If al you want is the "one sided deviation", you could drop the factor of 2. However keeping the factor of 2 is a worse but still valid bound.


Quote:
Originally Posted by eshmrt View Post
Since we're only looking at epsilon applied in one direction, meaning that we're only interested in nu being mu - 0.8 and not mu + 0.8, should we drop the leading 2 from the bound calculation? I'm not sure if I'm interpreting this bound correctly or simply overthinking things.
__________________
Have faith in probability
Reply With Quote
  #5  
Old 11-05-2017, 07:17 AM
henry2015 henry2015 is offline
Member
 
Join Date: Aug 2015
Posts: 31
Default Re: Chapter 1 - Exercise 1.9

Quote:
Originally Posted by magdon View Post
If \mu=0.9 and \nu\le0.1, it implies that |\nu-\mu|>0.8^- (any number slightly less than 0.8). By the implication bound,

P[\nu\le0.1] \le P[|\nu-\mu|>0.8^-]

By looking at the RHS, one can identify \epsilon for applying the Hoeffding bound.
Hi, I am a bit confused.

I thought when it says \nu\le0.1, it means 0\le\nu\le0.1 because smallest probably is 0; hence, 0.8\le|\nu-\mu|\le0.9....I am sure I miss something.

Any pointer?

Thanks!
Reply With Quote
  #6  
Old 09-11-2018, 03:03 PM
mike7 mike7 is offline
Junior Member
 
Join Date: Sep 2018
Posts: 1
Default Re: Chapter 1 - Exercise 1.9

Quote:
Originally Posted by magdon View Post
If \mu=0.9 and \nu\le0.1, it implies that |\nu-\mu|>0.8^- (any number slightly less than 0.8). By the implication bound,

P[\nu\le0.1] \le P[|\nu-\mu|>0.8^-]

By looking at the RHS, one can identify \epsilon for applying the Hoeffding bound.
If I am understanding the implications of this correctly, \epsilon = 0.8 is too large within the Hoeffding bound, correct? One would need to select some \epsilon < 0.8, perhaps arbitrarily?
Reply With Quote
  #7  
Old 10-19-2018, 03:07 PM
darknes darknes is offline
Junior Member
 
Join Date: Nov 2017
Posts: 3
Default Re: Chapter 1 - Exercise 1.9

Thank you

inzest porno
reife porno
sexo oral
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 02:59 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.