LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Homework 8 (http://book.caltech.edu/bookforum/forumdisplay.php?f=137)
-   -   Should SVMs ALWAYS converge to the same solution given the same data? (http://book.caltech.edu/bookforum/showthread.php?t=1333)

itooam 09-03-2012 02:10 PM

Re: Should SVMs ALWAYS converge to the same solution given the same data?
Thank you both for your help and advice.

I was running my implementation in quiet mode (-q) as it gets a bit tedius after a while having to scroll through the bumf to then get the results. I hadn't even considered maximum iterations! I took the quiet mode off, and saw exactly what you said Keith, for C >= 100 it was giving a warning each time of "WARNING: reaching max number of iterations... optimization finished, #iter = 10000000", so this quite clearly explains why the results for Ein and Eout seemed random when the ordering of the data was changed. It was just struggling to converge with this data given this "harder" margin of C and this early termination caused the apparent randomness in results.

The annoying thing is, looking at this LIBSVM README file, I can see no way to output the "number of iterations" from the "model" which is returned from the svmtrain function. So may have to run everything NOT in quiet mode in future :(

Many thanks :) Must say this homework has been the best yet, have learnt so much.

All times are GMT -7. The time now is 04:04 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.