LFD Book Forum Exercise 1.10d
 User Name Remember Me? Password
 FAQ Calendar Mark Forums Read

 Thread Tools Display Modes
#1
12-06-2017, 09:28 AM
 saitama Junior Member Join Date: Dec 2017 Posts: 2
Exercise 1.10d

I can see why coin c_1 obeys the Hoeffding bound since we restrict our attention to a single coin (eg a single bin). And i can understand why c_min does not hold since we pick an optimal value (ie minimum) over multiple coins (kind of like the best hypothesis over multiple bins).

However, I'm having a hard time understanding why the Hoeffding bound also applies to the c_rand coin. Although we don't pick an optimal value we do consider multiple coins (eg multiple bins). Does considering multiple coins not matter in this case??
#2
12-06-2017, 12:01 PM
 don slowik Member Join Date: Nov 2017 Posts: 11
Re: Exercise 1.10d

Just one bin is being considered after you have chosen it. Just like choosing bin 1..
Hoeffding should apply to any one of the 100,000 runs, but not to the 'best' or 'worst' run.
#3
12-08-2017, 07:57 AM
 saitama Junior Member Join Date: Dec 2017 Posts: 2
Re: Exercise 1.10d

I think I understand now. I guess the c_rand coin does only considering one bin at a time when choosing an optimal value. Its not like we search multiple coins. Thanks for the reply

 Thread Tools Display Modes Hybrid Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 09:19 PM.

 Contact Us - LFD Book - Top

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.