LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Homework 1 (http://book.caltech.edu/bookforum/forumdisplay.php?f=130)
-   -   Clarification Required for PLA problem approach (http://book.caltech.edu/bookforum/showthread.php?t=881)

pranav_s 07-18-2012 05:32 AM
Clarification Required for PLA problem approach
 
According to the statement (as far as i could infer) I :
1.Create a database of lets say 1000 points and apply the target function (randomly chosen) to get their respective o/p(+1/-1)

2. in question 7, N=10, I pick up 10 random points (1 sample set) from the created database and get my 'g' using the PLA. Now, since I have a 'g' on which points do I apply it and then calculate Pr[f!=g] exactly??
As mentioned I perform the same thing on 1000 sample sets. and calculate Average Pr and Average number of iterations to converge. So, essentially I am converging to 1000 different 'g's. Is this right?

similarly for N=100??
Please, correct if there is any discrepancy.

yaser 07-18-2012 10:05 AM
Re: Clarification Required for PLA problem approach
 
Quote:
Originally Posted by pranav_s (Post 3502)
Now, since I have a 'g' on which points do I apply it and then calculate Pr[f!=g] exactly?
On out-of-sample points, i.e., fresh points generated according to the same (uniform) distribution. You can generate as many of these points as you want to get better accuracy. If you want an exact answer, calculate the area where f({\bf x})\ne g({\bf x}) and divide by the total area (which is 4).

miguel.penalver@mail.com 07-18-2012 10:57 AM
Re: Clarification Required for PLA problem approach
 
Quote:
Originally Posted by pranav_s (Post 3502)
As mentioned I perform the same thing on 1000 sample sets. and calculate Average Pr and Average number of iterations to converge. So, essentially I am converging to 1000 different 'g's. Is this right?

similarly for N=100??
Right.

diethealthcare 05-18-2017 02:19 PM
Re: Clarification Required for PLA problem approach
 
:confused:


All times are GMT -7. The time now is 08:18 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.