LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 5 - Three Learning Principles (http://book.caltech.edu/bookforum/forumdisplay.php?f=112)
-   -   Exercises and Problems (http://book.caltech.edu/bookforum/showthread.php?t=261)

yaser 03-25-2012 12:25 AM

Exercises and Problems
Please comment on the chapter problems in terms of difficulty, clarity, and time demands. This information will help us and other instructors in choosing problems to assign in our classes.

Also, please comment on the exercises in terms of how useful they are in understanding the material.

ntvy95 06-23-2016 08:16 AM

Exercise 5.4
I have some unclear idea about the Exercise 5.4. The exercise itself states:


By looking at the data, it appears that the data is linearly separable
Here I interpret "looking at the data" as "looking at the whole data set including the training set and test set", is my interpretation correct? If yes, then we can't determine the dvc of both training set and test set (due to the fact it's hard for us to know how many hypotheses we have looked at to come at the conclusion "the data is linearly separable"), right?

The exercise also states:


We now wish to make some generalization conclusions, so we look up the dvc for our learning model and see that it is d+1. Therefore, we use this value of dvc to get a bound on the test error.
However, this statement confuses me. Assuming that we have never snooped on the data set, then the dvc = d + 1 should not be applied on the VC bound of the test error as the hypothesis set we use on test set has only one hypothesis - and that is the final hypothesis that has come out from the learning algorithm used on the training set, right? :confused: Or is this also a point that I need to give it to my answer to the exercise? :clueless: If that is the case then however the exercise also asks:


(b) Do we know the dvc for the learning model that we actually used? It is this dvc that we need to use in the bound.
Then which bound is refered here? The bound on the training set or the bound on the test set? If it's the bound on the test set then we should not use the dvc of the bound on the training set, right?

Thank you very much in advance.

subbupd 09-13-2017 03:02 AM

Re: Exercises and Problems
Should we not use the bound DVC on the training set?

I have this query as well!

LavishLimo 11-09-2017 09:11 PM

Re: Exercises and Problems
Same Here

All times are GMT -7. The time now is 06:49 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.