Thread: Exercise 4.6
View Single Post
  #2  
Old 11-08-2016, 02:09 PM
CountVonCount CountVonCount is offline
Member
 
Join Date: Oct 2016
Posts: 17
Default Re: Exercise 4.6

I have the same question. Can someone help here?

From my understanding having small weights is not perfect for sign(s), since this will lead to a signal that is often around 0 and thus a small change of just one input has a high chance to lead to a completely different output, if the sign changes.

So it would be better to have big weights, thus the signal is always pushed to the big number region and the sign is more stable.

But I maybe I'm just wrong here.
Reply With Quote