LFD Book Forum Exercises and Problems

#1
03-25-2012, 12:25 AM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,477
Exercises and Problems

Please comment on the chapter problems in terms of difficulty, clarity, and time demands. This information will help us and other instructors in choosing problems to assign in our classes.

Also, please comment on the exercises in terms of how useful they are in understanding the material.
__________________
Where everyone thinks alike, no one thinks very much
#2
06-23-2016, 08:16 AM
 ntvy95 Member Join Date: Jan 2016 Posts: 37
Exercise 5.4

I have some unclear idea about the Exercise 5.4. The exercise itself states:

Quote:
 By looking at the data, it appears that the data is linearly separable
Here I interpret "looking at the data" as "looking at the whole data set including the training set and test set", is my interpretation correct? If yes, then we can't determine the dvc of both training set and test set (due to the fact it's hard for us to know how many hypotheses we have looked at to come at the conclusion "the data is linearly separable"), right?

The exercise also states:

Quote:
 We now wish to make some generalization conclusions, so we look up the dvc for our learning model and see that it is d+1. Therefore, we use this value of dvc to get a bound on the test error.
However, this statement confuses me. Assuming that we have never snooped on the data set, then the dvc = d + 1 should not be applied on the VC bound of the test error as the hypothesis set we use on test set has only one hypothesis - and that is the final hypothesis that has come out from the learning algorithm used on the training set, right? Or is this also a point that I need to give it to my answer to the exercise? If that is the case then however the exercise also asks:

Quote:
 (b) Do we know the dvc for the learning model that we actually used? It is this dvc that we need to use in the bound.
Then which bound is refered here? The bound on the training set or the bound on the test set? If it's the bound on the test set then we should not use the dvc of the bound on the training set, right?

Thank you very much in advance.
#3
09-13-2017, 03:02 AM
 subbupd Member Join Date: Aug 2017 Location: Singapore Posts: 14
Re: Exercises and Problems

Should we not use the bound DVC on the training set?

I have this query as well!
#4
11-09-2017, 09:11 PM
 LavishLimo Junior Member Join Date: Nov 2017 Posts: 2
Re: Exercises and Problems

Same Here
__________________
[URL="http://www.lavishlimo.ca/"]Toronto Limo Service - Lavish Limo[/URL]

Best and Affordable Limo Services in Toronto & Mississauga with professional chauffeurs.

Phone: +1 647-524-5466

Business Hours: Mon to Fri 10 AM - 6 PM / Sat to Sun 9 AM - 4 PM

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 07:18 AM.