LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Homework 7 (http://book.caltech.edu/bookforum/forumdisplay.php?f=136)
-   -   Interpretations on Q8 and Q9? (http://book.caltech.edu/bookforum/showthread.php?t=4419)

eychen 09-19-2013 12:08 PM

Interpretations on Q8 and Q9?
 
Dear staff,

Would you please make an interpretation on the results of Q8 and Q9?
Namely, why does SVM outperform PLA as training set grows?

Someone mentioned VC dimension in one of the previous threads. However, I noticed that the VC dimension of SVM actually increases as training set grows:

N dVC (# of support vectors) probability of outperforming PLA
10 2.519 0.544
100 2.878 0.668
500 2.905 0.685

Whereas the dVC of PLA remains 3 in all cases. I think dVC may not be a very good approach to this question.

yaser 09-20-2013 05:30 AM

Re: Interpretations on Q8 and Q9?
 
Quote:

Originally Posted by eychen (Post 11496)
Would you please make an interpretation on the results of Q8 and Q9?
Namely, why does SVM outperform PLA as training set grows?

Just to clarify, your concern is that SVM continues to outperform PLA as the training set grows or that it starts to outperform PLA as the training set grows?

eychen 09-21-2013 03:19 PM

Re: Interpretations on Q8 and Q9?
 
My concern is that the probability of "SVM outperforms PLA" gets higher and higher as the training set grows. I find this a bit interesting because the VC dimension of SVM seems to approach that of PLA as the training set grows.


All times are GMT -7. The time now is 03:46 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.