LFD Book Forum meaning of gamma in polynomial kernel
 Register FAQ Calendar Mark Forums Read

#1
09-02-2012, 01:01 AM
 Andrs Member Join Date: Jul 2012 Posts: 47
meaning of gamma in polynomial kernel

In libsvm the polynomial kernel is defined in the following way:
(gamma*u'*v + coef0)^degree).
What is the meaning of gamma in the poly kernel? In our exercise the polynomial kernel only contains the parameters coef0 and degree (and C). There is no reference to a gamma parameter.
I have guessed the value 1 to gamma (no effect when multiplying the inner product) but I am not sure because its purpose is not clear for me in the poly case.
If we do not assign any values, the default value given by libsvm is 1/# features. In our case,it will be 1/2.
#2
09-02-2012, 01:23 AM
 tzs29970 Invited Guest Join Date: Apr 2012 Posts: 52
Re: meaning of gamma in polynomial kernel

See slide 6 of lecture 15, and the discussion starting about 21 minutes into the lecture.
#3
09-02-2012, 01:27 AM
 yaser Caltech Join Date: Aug 2009 Location: Pasadena, California, USA Posts: 1,478
Re: meaning of gamma in polynomial kernel

Quote:
 Originally Posted by Andrs In libsvm the polynomial kernel is defined in the following way: (gamma*u'*v + coef0)^degree). What is the meaning of gamma in the poly kernel? In our exercise the polynomial kernel only contains the parameters coef0 and degree (and C). There is no reference to a gamma parameter. I have guessed the value 1 to gamma (no effect when multiplying the inner product) but I am not sure because its purpose is not clear for me in the poly case. If we do not assign any values, the default value given by libsvm is 1/# features. In our case,it will be 1/2. Any clarifications about this gamma in poly is appreciated
As mentioned on slide 6 of Lecture 15, sometimes the polynomial kernel is defined with constants inside the expression that balance the relative value of the coefficients in the equivalent transformation. The slide uses different notation from that of libsvm. For our purposes, these constants are set to 1 (both gamma and coeff0 in the notation you mention).

Edit: I wrote this before I saw the above reply.
__________________
Where everyone thinks alike, no one thinks very much
#4
09-02-2012, 01:34 AM
 Andrs Member Join Date: Jul 2012 Posts: 47
Re: meaning of gamma in polynomial kernel

Thanks for the quick reply!..may be i should have been more alert
#5
09-02-2012, 06:24 AM
 htlin NTU Join Date: Aug 2009 Location: Taipei, Taiwan Posts: 601
Re: meaning of gamma in polynomial kernel

A simple way to view is that it is as if you have scaled all your down by before applying the no- polynomial kernel. Hope this helps.
__________________
When one teaches, two learn.
#6
09-03-2012, 03:04 AM
 Andrs Member Join Date: Jul 2012 Posts: 47
Re: meaning of gamma in polynomial kernel

Quote:
 Originally Posted by htlin A simple way to view is that it is as if you have scaled all your down by before applying the no- polynomial kernel. Hope this helps.
Thanks for the explanation!

 Tags libsvm, polynomial

 Thread Tools Display Modes Linear Mode

 Posting Rules You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules
 Forum Jump User Control Panel Private Messages Subscriptions Who's Online Search Forums Forums Home General     General Discussion of Machine Learning     Free Additional Material         Dynamic e-Chapters         Dynamic e-Appendices Course Discussions     Online LFD course         General comments on the course         Homework 1         Homework 2         Homework 3         Homework 4         Homework 5         Homework 6         Homework 7         Homework 8         The Final         Create New Homework Problems Book Feedback - Learning From Data     General comments on the book     Chapter 1 - The Learning Problem     Chapter 2 - Training versus Testing     Chapter 3 - The Linear Model     Chapter 4 - Overfitting     Chapter 5 - Three Learning Principles     e-Chapter 6 - Similarity Based Methods     e-Chapter 7 - Neural Networks     e-Chapter 8 - Support Vector Machines     e-Chapter 9 - Learning Aides     Appendix and Notation     e-Appendices

All times are GMT -7. The time now is 02:22 PM.