LFD Book Forum

LFD Book Forum (http://book.caltech.edu/bookforum/index.php)
-   Homework 5 (http://book.caltech.edu/bookforum/forumdisplay.php?f=134)
-   -   *ANSWER* Hw 5, q10 (http://book.caltech.edu/bookforum/showthread.php?t=4309)

a.sanyal902 05-24-2013 01:07 AM

*ANSWER* Hw 5, q10
 
I understood why the answer to Q10 is as given.

However, I'm a little confused as the given function is not differentiable and we wont be able to use it for SGD. Can this be overcome, as we did in logistic regression by using the properties of the sigmoid function?

yaser 05-24-2013 01:26 AM

Re: *ANSWER* Hw 5, q10
 
Quote:

Originally Posted by a.sanyal902 (Post 10938)
I understood why the answer to Q10 is as given.

However, I'm a little confused as the given function is not differentiable and we wont be able to use it for SGD. Can this be overcome, as we did in logistic regression by using the properties of the sigmoid function?

The error function can be softened into a smooth version like the sigmoid was used to soften a hard threshold. One can also keep the functional form and use the right or left derivative here as a fix.

a.sanyal902 05-24-2013 02:17 AM

Re: *ANSWER* Hw 5, q10
 
Thanks a lot for the reply Prof. !


All times are GMT -7. The time now is 11:55 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
The contents of this forum are to be used ONLY by readers of the Learning From Data book by Yaser S. Abu-Mostafa, Malik Magdon-Ismail, and Hsuan-Tien Lin, and participants in the Learning From Data MOOC by Yaser S. Abu-Mostafa. No part of these contents is to be communicated or made accessible to ANY other person or entity.