LFD Book Forum  

Go Back   LFD Book Forum > Book Feedback - Learning From Data > Chapter 5 - Three Learning Principles

Reply
 
Thread Tools Display Modes
  #1  
Old 03-24-2012, 11:25 PM
yaser's Avatar
yaser yaser is offline
Caltech
 
Join Date: Aug 2009
Location: Pasadena, California, USA
Posts: 1,472
Default Exercises and Problems

Please comment on the chapter problems in terms of difficulty, clarity, and time demands. This information will help us and other instructors in choosing problems to assign in our classes.

Also, please comment on the exercises in terms of how useful they are in understanding the material.
__________________
Where everyone thinks alike, no one thinks very much
Reply With Quote
  #2  
Old 06-23-2016, 07:16 AM
ntvy95 ntvy95 is offline
Member
 
Join Date: Jan 2016
Posts: 37
Default Exercise 5.4

I have some unclear idea about the Exercise 5.4. The exercise itself states:

Quote:
By looking at the data, it appears that the data is linearly separable
Here I interpret "looking at the data" as "looking at the whole data set including the training set and test set", is my interpretation correct? If yes, then we can't determine the dvc of both training set and test set (due to the fact it's hard for us to know how many hypotheses we have looked at to come at the conclusion "the data is linearly separable"), right?

The exercise also states:

Quote:
We now wish to make some generalization conclusions, so we look up the dvc for our learning model and see that it is d+1. Therefore, we use this value of dvc to get a bound on the test error.
However, this statement confuses me. Assuming that we have never snooped on the data set, then the dvc = d + 1 should not be applied on the VC bound of the test error as the hypothesis set we use on test set has only one hypothesis - and that is the final hypothesis that has come out from the learning algorithm used on the training set, right? Or is this also a point that I need to give it to my answer to the exercise? If that is the case then however the exercise also asks:

Quote:
(b) Do we know the dvc for the learning model that we actually used? It is this dvc that we need to use in the bound.
Then which bound is refered here? The bound on the training set or the bound on the test set? If it's the bound on the test set then we should not use the dvc of the bound on the training set, right?

Thank you very much in advance.
Reply With Quote
  #3  
Old 09-13-2017, 02:02 AM
subbupd subbupd is offline
Junior Member
 
Join Date: Aug 2017
Location: Singapore
Posts: 7
Default Re: Exercises and Problems

Should we not use the bound DVC on the training set?

I have this query as well!
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 01:44 AM.


Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.