LFD Book Forum  

Go Back   LFD Book Forum > Course Discussions > Online LFD course > Homework 1

Reply
 
Thread Tools Display Modes
  #1  
Old 01-19-2013, 02:07 AM
alinsoar alinsoar is offline
Member
 
Join Date: Jan 2013
Posts: 17
Default Where to find explanation for Hoeffding's Inequality ?

I am looking for a detailed explanation for this.

It seems that this inequality is the mother of ml.

I skim the videos of Andrew Ng and cannot find the place where it is detailed.

Does some of you help me to find a good resource, with proof and examples ?

Thanks.
Reply With Quote
  #2  
Old 01-19-2013, 09:12 AM
htlin's Avatar
htlin htlin is offline
NTU
 
Join Date: Aug 2009
Location: Taipei, Taiwan
Posts: 601
Default Re: Where to find explanation for Hoeffding's Inequality ?

If you want to try proving by yourself, please feel free to visit Homework e/2 of NTU ML Class 2012:

http://www.csie.ntu.edu.tw/~htlin/co...oc/hw0_5_e.pdf

Hope this helps.
__________________
When one teaches, two learn.
Reply With Quote
  #3  
Old 01-19-2013, 11:16 PM
alinsoar alinsoar is offline
Member
 
Join Date: Jan 2013
Posts: 17
Default Re: Where to find explanation for Hoeffding's Inequality ?

Thank you !

This is exactly what I need.

However, I need some guidance to make a proof of each step. Otherwise, alone, I suppose I will spend many hours on each point ...
Reply With Quote
  #4  
Old 01-21-2013, 01:50 AM
alinsoar alinsoar is offline
Member
 
Join Date: Jan 2013
Posts: 17
Default Re: Where to find explanation for Hoeffding's Inequality ?

Somebody told me to look over this book, and after I consulted the book I definitively decided to buy it.

It is the best book fitted on the field I ever saw.

H's inequality is in the 5th chapter well proved and explained.
Reply With Quote
  #5  
Old 04-03-2013, 09:21 PM
Michael Reach Michael Reach is offline
Senior Member
 
Join Date: Apr 2013
Location: Baltimore, Maryland, USA
Posts: 71
Default Re: Where to find explanation for Hoeffding's Inequality ?

Quote:
Originally Posted by alinsoar View Post
I am looking for a detailed explanation for this.
It seems that this inequality is the mother of ml.
Interesting. I thought we were now studying the theoretical underpinnings of why ML works - but that the real mother of ML is the million dollar prize from Netflix. That is, the mother of ML is that there are effective techniques that can be seen to work for prediction: You know it works, because you leave some of the data over for testing, and when you're done, the g hypothesis does a very good job predicting on the new test data.
When you have that, you have Machine Learning, and the theoreticians can come later and explain why. Am I wrong?

As an example, I do know that Quantum Computing was no more than an interesting suggestion by various people (Feynman) until Shor came up with an actual working algorithm to factor very large numbers. [Working, if you'll just build a quantum computer.] That's when the field took off.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 06:40 PM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.