LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   General Discussion of Machine Learning (http://book.caltech.edu/bookforum/forumdisplay.php?f=105)
-   -   Rethinking statistical learning theory: learning using statistical invariants-Vapnik (http://book.caltech.edu/bookforum/showthread.php?t=4866)

grantrostig 11-17-2018 08:25 PM

Rethinking statistical learning theory: learning using statistical invariants-Vapnik
 
New paper:

Rethinking statistical learning theory: learning using statistical invariants
Vladimir Vapnik and Rauf Izmailov
https://link.springer.com/article/10...994-018-5742-0

After doing the Edx course and reading the book and e-chapters, I was of course excited to find Vapnik's possibly important new improved approach to ML.

The two main ideas, which I believe are new:

1) vSVM - the SVM but with V-matrix
2) Using Statistical Invariants to improve convergence without extra training samples. LUSI Learning Using Statistical Invariants.

Here is the paper, which I have not read, because I can't get a copy that fits my budget (less that the $39 from Springer).
Vapnik, V. & Izmailov, R. Mach Learn (2018). https://doi.org/10.1007/s10994-018-5742-0

However, Vapnik has given at least three related lectures in late 2018 (including slides with complicated math), one of which is on youtube here:
https://www.youtube.com/watch?v=rNd7PDdhl4c

Most intriguing to me, is his comment suggesting that these new techniques are more powerful than deep neural networks. I didn't think that was currently possible in general, or at least not in certain domains, ie. image recognition etc. I'm probably missing something.

Can anyone, or the authors :), comment in detail about how this paper fits into the framework of ideas presented in the book?

aradralami 05-14-2019 01:10 AM

Re: Rethinking statistical learning theory: learning using statistical invariants-Vap
 
which text book does he talk about at 26:28 ?


All times are GMT -7. The time now is 08:03 PM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.