View Single Post
Old 08-17-2012, 03:05 AM
invis invis is offline
Senior Member
Join Date: Jul 2012
Posts: 50
Default Re: Clarification on HW6-Q8

Only product of the form ... w_{ij}^{(l)} \delta_j^{(l)}... count as operations.

On backward we have: \delta_i^{(l-1)} = (1-(x_i^{(l-1)})^2) \sum_{j=1}^{d^{(l)}}w_{ij}^{(l)} \delta_j^{(l)}

d^{(2)}=1 and d^{(1)}=3 and +1 (constant) for layer (1). So we have the same 4 operations for 2-1 layer, and obviously 18 operations for 1-0 layer. Or we dont need to compute \delta for constants ?
Reply With Quote