LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Chapter 3 - The Linear Model (http://book.caltech.edu/bookforum/forumdisplay.php?f=110)
-   -   Pocket Algorithm (http://book.caltech.edu/bookforum/showthread.php?t=4525)

mddsangster 10-13-2014 09:14 AM

Pocket Algorithm
 
I'm working on coding the pocket algorithm, however I feel I have hit an impasse. I'm not sure if it is a bug in my code or a flaw in the inherent structure of the pocket algorithm, but when testing the code on a known linearly separable data set, the algorithm often 'settles' on a non-optimal weight vector (i.e. one where Ein != 0). I believe this is due to the fact that the algorithm does not allow for weights producing higher values of Ein even if those values may later lead to an even lower Ein.

So, what I'm asking is, should the pocket algorithm always be able to find a linear classifier that separates separable data?

yaser 10-13-2014 12:32 PM

Re: Pocket Algorithm
 
Quote:

Originally Posted by mddsangster (Post 11777)
I believe this is due to the fact that the algorithm does not allow for weights producing higher values of Ein even if those values may later lead to an even lower Ein.

Pocket in fact does not interfere at all with what is allowed. All it does is record the best PLA solution so far, but otherwise let PLA run as it would otherwise.

elyoum 05-12-2016 02:23 AM

Re: Pocket Algorithm
 
Quote:

Originally Posted by yaser (Post 11778)
Pocket in fact does not interfere at all with what is allowed. All it does is record the best PLA solution so far, but otherwise let PLA run as it would otherwise.

really you help me yaser, good job

habertezi.com 07-30-2016 01:14 PM

Re: Pocket Algorithm
 
Türkiye'nin en büyük haber sitesi Son dakika haberler


All times are GMT -7. The time now is 01:22 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.