View Single Post
  #3  
Old 06-05-2013, 01:35 PM
Elroch Elroch is offline
Invited Guest
 
Join Date: Mar 2013
Posts: 143
Default Re: Clarification - Support Vectors decrease no. of features of W

I spotted a less sophisticated way of thinking about it which seems helpful to me.

If you merely assume that general points which are associated with a particular target (say +1) are more likely to be near points in a sample D with that target than further away from them, then the bigger the margin, the lower the probability that a general point with target +1 will be wrongly classified (because the bigger the minimum distance from any point in D to a point that would be classified differently).

This ties in quite intuitively with the idea of distances from support vectors (or some sort of transformed distance if kernels are used) being the basis of the hypothesis.
Reply With Quote